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ABSTRACT 

This study involved secondary teachers in the 
evaluation, modification, and use of a program built and 
experimentally tested in elementary schools. Program reactions were 
gathered from teachers who would eventually use the program, and 
evaluations were also obtained from instructors outside the 
experiment. JEvaluations from both groups were similar. A three-group 
design was used in testing that consisted of partnership, treatment, 
and control teachers. No differences in degree of program 
implementation were found between partnership and treatment teachers, 
but both of these groups implemented more than the control 
instructors did. Among other findings, program teachers differed 
notably from control teachers in that program insti-uctors used more 
problem-solving strategies. Further, significant differences in 
problem-solving scores were noted for program pupils when contrasted 
to students in control classes, and gains in student achievement were 
paralleled by higher problem-solving implementation scores in program 
instructional situations. This document covers general issues in 
program implementation and working with secondary teachers, and 
concludes with suggestions for future investigation. (MP) 
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The* researcii reported here involved secondary teachers in the evalua- 
tion, modification, and use ot a niatfiemat ics program that had been bun It 
and experimentallv tested in elementary schools. In addition to obtaining 
reactions to the program from teachers who would eventually use the pro- 
gram, evaluations were also obtained trom secondary mathematics teac'-ers 
who were not a part of the experimental program. 

It was telt that teachers who were and were not asked to use the pro- 
gram might use different criteria for evaluating and modifying the program, 
However, it was tound that both groups of teachers made similar recommenda- 
tions. Still, the comparison between two groups of teachers proved valuable 
because it suggested context differences in .,.i,ooi districts that appear 
relevant to implementation success. 

In testing the program, a three-group design was utilized. The imple- 
mentation of the program was compared for partnership teachers (teachers 
who had a chance to modify the program); treatment teachers (teachers who 
were asked to use the modified program, but who played no role in program 
development); and control teachers. No differences were found in the degree 
of program implementation for partnership and treatment teachers. However, 
both groups ot teachers implemented more aspects of the program than did 
control teachers. 

It was found that program teachers differed notably from control teach 
ers in that they used more problem-solving strategies than did control 
teachers. These implementation differences are reflected in student per- 
formance. That is, weak differences were found in general achievement dif- 
ferences in favor of students in program classrooms (general program imple- 
mentation did not differ sharply in program and control classrooms). How- 
ever, signi f leant differences in problem-solving scores were* evidenced for 
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program students in contrast to students in control classes. These gains 
student achievement were paralleled by higher problem-solving implementa- 
tion scores in program than control classrooms. 

General issues ^n program implementation and working with secondary 
teachers are discussed in the report. Finally, detailed suggestions for 
future program modification and research are discussed. 
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I'revioub kesearcti 

N atura I ist ic Study 

Ihe researcl, presented m this report is based upon three previous 
studies which were supported by two grants from the National Institute of 
Education. Ir, 197S we Completed a large observational study of teaching 

ef fectivei.ess in third-grade mathematics classrooms (Good and Crouws , 

m 

1975). The purpose of that research was to determine whether it was possi- 
ble to identify teachers who were consistent (across different groups of 
Students) and relatively effective or ineffective, using student perforn- 
ance on the Iowa Test of Basic Skills as an operational criterion. Further- 
more, it was our intention to observe teachers who differed in effective- 
ness and to see if differences in their classroom behavior could be identi- 
fied. 

To identify patterns of teacher behavior which affected student learn- 
ing, it was considered desirable to-focus all initial observation upon 
classroom activity during the teaching of a particular subject. Mathematics 
instruction was chosen because of its importance in the elementary school 
curriculum (reading and mathematics are com^nonly accepted as the major cur- 
riculum areas i,n elementary schools). We also thought that more teacher and 
school variance would be associated with students' mathematics performance 
than reading performance. This assumption has now received empirical .sup- 
port from Coleman's analyses of data from the International Educational 
study ( 1975) . 

The research was conducted in a -chool district just outside the core 
of a large urban city* The student r -lation was primarily middle-class, 
but 3 number of students from low- and high-income homes attended target 
schools* Teachers in the district were using the same textbook series and 
the district had a stable population* 
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Over one hundred third- and fourth-grade teachers were initially 
studied* The data unit for the investigation was individual students' 
scotes on the mathematics section of the Iowa Test of Basic Skills, Data 
fpr teachers were then compiled by computing the njean residual gain score 
(from the scores for students) over cor-secujt ive years. 

We identified nine teachers who were 'j/elatively effective (in terms of 
the operational definition of effectiveness being utilized) and stable on 
total math residual scores across two consecutive years. We also found nire 
teachers who were relatively ineffective and stable across two consecutive 
years. During the year of observation, the more and less effective teachers 
again maintained their relative patterns of achievement. Hence, thege teach- 
ers were stable across three years. 

Observational data were collected in forty-one classrooms, to protect 
the identitv of the relatively effective and ineffective teachers. Approxi- 
mately equal numbers of observations were made in all classrooms (6-7), 
Data were collected by two trained observers (both certified teachers) who 
worked full-time and lived in the target city. Each coder visited all fort - 
one teachers and made about one-half of the observations obtained lu a given 
classroom. Furthermore, all observations were made without knowledge ot 
the teachers' levels of effectiveness. 

Four basic sets oT information were collected in the study. First, 
time measures were taken to describe how mathematics instructional time 
was utilized, A second set of codings were low-inference descriptions of 
teacher-student interaction patterns. These data were collected with the 
Brophy-Good Dyadic System (1970), A third set of dara were high-inference 
variables drawn from the work of Emmer (1^73) and Kounin (1970), Checklists 
were also used to describe materials and homework assignments (Good and 
Grouws , 1975;, 
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Detailed accounts ol the* procedures and results can be lound elsf-wliere 
(Good and Grouws, 1975; Good and Grouws , 1977). In brief, teach'ers' ability 
to obtain relatively high residual mea;^ scores appeared to be strongly asso- 
ciated with the following factors: (1) whole-class instruction; (2) gener- 
ally c lear ."instruct i on and availability of information to students as need- 
ed (process feedback, in particular); (']) a non-evaluative and relaxed 
learning env ironinent which was task-focused; (4) higher achievement expecta- 
tions (more homework, faster pace); and (^) classrooms which were relative- 
ly free of major behavioral disorders. 

Teachers who obtained high student achievement test scores were active 
teachers . They presented students with a meaningful and clear presentation 
of what was to be learned, provided developmental feedback when it was need- 
ed, structured a corrmon seatwork assignment, and responded to individual 
students* needs for help. 

We were aware that our ii^tial results were only correlational data 
and that they did not necessarily imply that differences between high- atmI 
low-achieving teachers caused student achievement. It could very well be 
that behaviors not studied in our observational research are more directly 
related to achievement (for example^, more effective teachers plan more thor- 
oughly and because of this, they are more task-focused, assign more home- 
work), or that these teachers taught more actively because they had more 
energy or because of other personality character i st i c s . J^e felt that it was 
important to determine whether a more direct association could l)e estab- 
lished between the behaviory whicn were identified in our olrservat i Ona 1 , 
naturalistic study and student achievement. 

Experimental Study I: Teacher Training Program 

We were pleased that some consistent differences could be found in 
correlational research between relatively effective and ineffective 



manhematics teachers* However, at that point we only had a descr^'ption of 
how more and less effective teachers -(in our sample) behaved differently. 
We^did not know if teachers who did not teach the way more effective teach- 
ers did could change their behavior or whether students would benefit if 
teachers were trained to use new methods. With the assistance of another 
grc^nt from the National Institute of Education, we began a new type of 
inquiry, to determine whether teachers could be taught the behaviors asso- 
ciated with higher pupil achievement, and v^ether such teacher training 
would improve the mathematics performance of students. (For detailed ac-> 
cpunts of the procedures and results of this experimental work, the inter- 

* 

ested reader shoold consult our 1979 final report; Good and Grouws , 1979a.) 
The training program . In writing the teacher training materials, our 
'earlier naturalistic finding^ were integrated with the recent naturalistic 
research of others and with existirt| experimental research in mathematics 
education, and translated into an instruct iona4 program. Some of the vari- 
ables we tested in our experimental program did not come directly from 
teaching behaviors measured in our earlier studies, 'but were instead based 
upon what observers had seen in classrooms. Still other variables (e.g., 
mental computations) came from experimental studies. The training program, 
• resulted in a 45-page manual for teachers. The program, as pointed out else- 
where (Good and Grouws. 1979a), is a system of instruction: (1) instruc- ' 
tional activity is initiated and reviewed in the context of meaning; (2) 
students are prepared for each lesson stage to enhance involvement and to 
minimize errors; (3) tt^e principles of distributed and successful practice 
are built into the program; (4) active teaching is demanded, especially in 
the developmental portion of the lesson (when the teacher explains a con- 
cept beins studied, its importance, etc.). An overview of the program is 
presented in Table 1 (the entire program can be found in Appendix 1). 
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In the ia7S naturalistic studs,' emphasis las placed upon internal 
validity. We chose a relatively stable school district (few changes in 
teacher personnel) in which a common textbook was used in all classrooms, 
and where student populations were comparable across schools and classrooms 
The reason for these controls was to exclude as many rival hypotheses as 
possible to the conclusion that teachers and teaching were affecting stu- 
dent learning. In the 1978 experimental sttidy, external validity was empha- 
sized. A more heterogeneous school population was sampled because we felt 
this would be a. more legitimate test of the training program. Details ot 
the ti-ain-lng procedures, a description of the sample, and more details on 
the results of the experiment can be .four.] in Good and Grouws (1^79a, 
'1979b). A brief summary of the results follows. 

f ■ 

Observers' records indicated that the experimental teachers implemen- 
ted the program very well (with the exception of certain recommendations 
concernirg how to conduct the development portion of the lesson). Because 
experimental teachers did use the program and because the frequencies of 
their behaviors related to program recommendations varied significantly 
from those ot control teachers/ it was possible to determine how the experi- 
mental training and subsequent teaching activity intluenced student achieve- 
ment and attitudes. For implementation information see Table 2. 

Pre- and post-testing with the SRA standardized achievement test 
indicated that atter two and one-half months ot the program, students in 
experimental classrooms scored five months higher than those in the control 
classrooms. Results are presented in T^ble 3. Regular end-of-year testing 
by the Tulsa public school system indicated that approximately three months 
after the program had ended, the experimental students were still perform-* 
in^ better than the control students. We also utilized a content test (con- 
structed by Dr. Robert Reys) which attempted to more closely match the 
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material that teachers were presenting than did the standardized test. The 
results on this test also showed an advantage for experimental classes, 
although differences between control and experimental classrooms were not 
as large they were on the standardized achievement test. 

Results of pre- and post-testing on a ten-item attitude scale revealed 
that experimental students reported significantly more favorable attitudes 
at the end of the experiment than did control students. Also, it is impor- 
tant to note that anonymous feedback from teachers in tne project indicated 
that they felt the program was practical and that they planned to continue 
usm^ it in the future. 

Research elsewhere indicate that teachers have a favorable reaction 
to the program, even when it is presented and discussed without the involve- 
ment ot the developers (Keziah, 1980; Andros and Freeman, 1981). Obviously, 
if teachers are to continue using any program, they must feel comfortable 
with It; there appear to be sufficient data to suggest that teachers are 
reasonably pleased with the training program we have developed. 

Interact ions of student and teacher characteris t ics with the treatment 
program . To explore achievement patterns more fully in terms of student and 
teacher characteristics, was considered important to del me teacher anu 
student types more broadly. Much of the responsibility for the conceptual- 
ization and analysis in this project was assumed by Dr. Howard Ebmeier, and 
more detail can be found in his dissertation (Ebmeier, 197B) and m a jour- 
nal article about these results (Ebmeier and Good, 1^). 

To develop student typologies, an instrument (Aptitude Invenj:ory) 
was designed to assess student characteristics which mighf^interact with 
key features of the treatment program, identifiable teacl^er characteris- 
tics, and/or classroom procedures. To obtain teachers/ views of the 
characteristics, organization, and tvpical activities of their classrooms, 
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a questionnaire was developed (faaching Style Inventory). The Aptitude 
Inventory was administered to all students in the sample and the Teaching 
Style Inventory was administered to each teacher. 

Cluster analysis was used to group stud«?nts and teachers each into 
tour types. The statistical properties of the 4x4x2 factorial design 
were tested using analysis of variance procedures. The residual scores on 
the SRA mathematics tests were the dependent variable. All main and inter-- 
active effects among and betv/een teacher types, student types, and treat- 
ment types r contro 1 or experimental ) were statistically significant. 
Details on the results and their interpretation can be found elsewhere 
(Ebmeier, 1978; Ebmeier and Good, 1979). Only a tew conur.ents on the find- 
ings will be presented here. 

The results suggested that the treatment generally worked (i.e., the 
means m each cell were in favor of the treatment group), but th-e program 
was clearly more beneficial for certain combinations of teacher and student 
groups than tor others. The data collectively indicated that teachers who 
implemented the model got good results, yet some teacher types chose to use 
more facets of the program than did other teachers. 

One ot the most interesting findings of the study was the interactions 
between teacher type and treatment type. There was a strong teacher effect 
in the treatment condition that was not found in the control sample. This 
interaction occurred tor types 2 ( exper ienced/ unsure ) and 3 (educated/ 
secure) teachers, but not for the other two teacher types. 

Since people are ^ore likely to adopt and internalize ideas which are 
consonant with their existing beliefs, one could predict that teachers who 
already believe in an active instructional model or teachers who are unsure 
using their present instructional strategies would be most likely to implt-- 
ment the exper i.nenta 1 treatment program it requested to do so. These 
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results are consiste .t with the findings here. Although the results of the 
experimental field study have strong implications, they must be interpreted 
in light of the evidence that the experimental treatment worked better tor 
some combinations of teachers and students than it did for other comhina- 
t ions . 

As we noted in our 1979 final report, at that time Mr. Terrill Becker- 
man was completing a dissertation examining other interactions of the treat- 
ment program with student characteristics. In particular, his dissertation 
was an attempt to form student clusters on the basis of teacher descrip- 
tions of students rather than based upon student descriptions, which were 
used in the Ebmeier study. A detailed account ci Dr. Beckerman's work can 
be found elsewhere (Beckerman, 1981); how>iver, a brief description of his 
work is included in Appendix 2. 

This material has been appended because it is not dirtiCtly relevant 
to the work being presented in this final report. However, these results 
are interesting and broaden the findings presented in our 1979 final re- 
port. Another important addition to the 1979 report is found in Appendix 
1. In writing the 1979 report, we indicated our intentions to examine the 
effects of the treatment upon students at different achievement levels. The 
interested reader can find these results for our fourth-grade experimental 
study m Appendix 3. 

Experimental Study 11: Verbal Problem Solving 

Much of the research described briefly above was still in progress 
when the decision about the second experimental study had to be made 
fe.g., resources had to be allocated well In advance of data collection, 
the school district needed to be informed about the nature of the second 
field experiment, etc.). In retrospect, we feel that our ultimate decision 
to shift our concern to the development of a second treatment program 



(verbal problem solving) and to test older students (sixth, as compared to 
the fourth graders m the first tield experiment} in the same school dis- 
trict was adequate, but perhaps not optimal* 

We debated several possible topics for study* We considered an affec- 
tive treatment; however, the fact that achievement gains appeared not to 
be coming at the expense of students' affective reactions suggested that 
there were no compelling reasons to proceed in this direction. A second 
issue related to the field experiment data was the relatively poor Impiemen- 
tation of the development phase of the lesson. However, modifying this as- 
pect of the program seemed too time-consuming. V/e also considered refining 
the treatment to make it more suitable for certain types of students and 
teachers. At this point, however, the Ebnieier typology work was still in an 
early stage of data analysis and although his initial work indicated that 
important interactions were occurring, it seemed premature to assess their 
importance or meaning. Because of Ebmeier's initial interesting results, we 
did make the decision to devote extra resources so that he and Beckerman 
could pursue their analyses of existing typologies more fully. 

Ultimately, we decided to study verbal problem solving. As mentioned 
previously, two dependent measures of achievement were utilized in the 
first experimental study, the SRA achievement test and a special consent 
test which [)r. Keys had designed. The reliability of Dr. Reys' instrument 
as a whole was acceptable, and the test siiowed that experimental students' 
achievement was superior to that of control students.^ However, the reli- 
ability for the three subtests of the instrument (knowledge, skill, and 
problem solving) indicated that only the skill subtest had adequate reli- 
ability for separate analysis (and on this subtest, the achievement o\ the 
treatment group surpassed that of the control group). In examining the 
means of the other two subtests, we found that treatment students did better 
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controls on the knowledge items, but that there was little difference 
between the two groups on the verbal problem-solving test. However, it 
was impossible to tell whether the similar performance of the two groups 
was real or only a tunction of poor reliability (too few items'). We were 
disappointed in these findings, because we felt that if mathematics knowl- 
edge is to be applied to "everyday life," student need practical problem- 
solving skills (e.g., the ability to determine whether the 12-ounce or 
l6~ounce package is the better buy). Unfortunately, extant literature on 
instructional behavior and students' performance on verbal problem solving 
did not provide any consistent orientation or procedure for classroom prac- 
tice . 

Tbere was no data base for building a treatment program, especially 
data resulting from naturalistic studies of classroom teachers. Because 
we thought it was important to understand and to possibly improve students' 
ability tor solving relatively simple verbal problems, we decided to make 
a systematic ^ffcort to develop testable instructional strategies in this 
area • 

We therefore decided to shift our concern and to broaden the instruc- 
tional program by addin^:' ^ section on verbal problem solving. The first 
task was to develop a training manual detailing instructional strategies 
which teachers might use to teach students verbal problem-solving skills. 
The five techniques which teachers were requested to use were problems 
without numbers, writing verbal problems, estimating the answer, reading 
verbal problems, and writing open sentence problems. Discussion of these 
strategies and related research can be found elsewhere (e.g., Suydam and 
Weaver, 1970). A complete copy of the training manual is in Appendix A. 

It was also necessary to make three related decisions: (1) whether 
to test the instructional materials associated with verbal problem solving 
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1th or without the program that had been designed for the tirst field ex- 
periment; (2) at what grade levels to test the program; (3) whether to ob- 
serve or not. 

It seemed important to determine whether gains in other mathematics 
knowledge and skiil areas, such as those in Experiment i, could be obtained 
while students' performance on verbal problem-solving skills was also 
improved. Hence, it seemed more reasonable to expand and test a comprehen- 
sive program rather than to test only a verbal prob lem-solv'^g strategy. 
In retrospect, we feel reasonably good about this decision, since subse- 
quent research has suggested that the verbal problem-solving training 
manual does not appear to have effects independent of the broader treat- 
ment program (Engelhardt, 1980). 

The grade level decision was a relatively straightforward one. We 
could have tested the program at the fifth-grade level and thereby have 
gained the advantage of studying the same students over consecutive years. 
However, the movement from school to School within the student population 
was relatively high. This meant that teachers wCuid have some fifth-grade 
students who had been in the program and "some who had not. To avoid this 
confusion, we decided to test the modified program at the sixth-grade 
level. We assumed that it would be possible to test the program on an "un- 
contaminated" population of classrooms, even though we stayed in the same 
school district. Using a sixth-grade sample also provided an older popula- 
tion upon which to test various questions about the general program. 

The final decision we had to make concerned the role of observation 
in the field experiment. Limited funds, the fact that new observers had 
to be trained, and our interest in devoting resources to building a new 
treatment program (as well as exploring the existing ^ypology data), collec- 
tively influenced our decision about whether to have limited observation 
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or none at all. We ultimately decided to test the expanded program without 
classrooir observation, because the general izabil ity of the findings would 
be increased JJ^ positive results were obtained. Our interest in expanding 
the results (not makiag observation a necessary part of the treatment) was 
supported by the results of Anderson, Evertson, and Brophy (1979), which 
suggested that their treatment had an effect upon student achievement hich 
was not moderated by the presence of observers. 

Unfortunately, despite our efforts to secure an "uncontammated" popu- 
lation of sixth-graders, a degree of potential contamination was present in 
the design. In part, we were "victimized" by our previous success. The 
school district was sufficiently impressed with the results of the first 
study that they wanted all tourth-grade teachers to be exposed to the 
model. Due to this dissemination, as well as our own debriefing of control 
teachers in the first experimental study, program descriptions of the first 
experimental treatment were present in both treatment and control schools 
and hence, potentially available to sixth-grade teachers. 

Procedures; Field Experiment II 

The second field experiment was conducted one year after the first 
field experiment and in the same school district. The expanded program (the 
training manual used in experiment one plus the verbal problem-solving 
manual) was evaluated in thirty-six sixth-grade classrooms, and the general 
design and training procedures were the same as those utilized in the first 
field experiment (see Good and Grouws^ 1979a, for complete detail*). 

The only exception to the similarity of conditions between field exper 
iment one and two was a major one. In the first field experiment, all teach 
evs ^ere using a semi-departmentalized structure (teachers taught only two 
or three different subjects a day). In the second field experiment, three 
organizational patterns were represented in the teacher sample. Some 
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teacliers utilized the sem i -department a I i zed structure; other teachers 
taught only math as a special subject (sixth- grade teachers tau^ftt math' to 
several different sixth-grade classes); and some teachers were m open 
classes (where team teaching and individualized instruction were prevalent) 
The semi-departmentalized structure and math-as-a-spec ial-suh ject 
-organizational patterns seemed to be consistent with the basic data base 
from which the project had been developed. The open classroom structure 
was not* However, the school district expressed interest in including some 
open classrooms m the design in order to have teachers exposed to the 
rationale for the active teaching aspects of our program. We included tliese 
teachers m the design, but emphasized both to administrators and to teach- 
ers during the training program that the treatment would be conceptual 
rather than operational (if teachers became interested in certain aspects 
of the program, the extent and form of adoption would be left to them). 

Results of Exper imentg'l Field Study II 

The raw means and standard deviations for the SRA (pre- and post-test) 
and the problem-solving post-test, by treatment condition and by organiza- 
tional structure, are presented in Table 4* As can be seen, student perform- 
ance increased t rom pre to post in all cases on the forty-item SRA test. 
Furthermore, all treatment groups surpassed the performance of the equiva- 
lent control ^roups^ Two of the three treatment groups had Ingher mean per- 
formances than equivalent control groups on the problem-solving test/""ti^ 
should be noted that the exception, l' ^ open treatment classes, had tlie 
lowest pre-test score on the SRA. 

Also, as can be seen m Table 4, the mean pre-test SRA scores (or con- 
trol teachers were generally lower than the scores in the equivalent treat- 
ment group. An exception occurred in the math-as-a-spec i a I -sub ject class.'^s, 
where the pre-SRA mean scores of the treatment classes slightly exceeded 
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those of control classrooms. To reiterate, in terms of raw gains, the treat- 
ment groups' performance was generally superior to that of the equivalent 
control groups. 

The results of the formal analyses using adjusted mean scores indica- 
ted that the performance of the treatment group was not significantly high- 
er than that of the control group on the post-SRA test, using the pre-SRA 
test as a covariant (with all forms of classroom organization included m 
the analysis). Sinilar results were also obtained when open classrooms were 
excluded from the analysis. 

A similar analysis was performed on the problem-solving test (using 
the pre-SRA test as a covariant) to compare the significance of adjusted 
means atross all treatment and control classrooms. This analysis indicated 
that the performance of the treatment group exceeded that of the control 
group in a way that approached significance (p = .10)* 

Earlier it was mentioned that we had some reservations about including 
open classroom teachers in the study because the program had not been de- 
signed for such settings* When open-space teachers were excluded, the com- 
parison on the problem-solving test revealed that the treatment group's per- 
formance was significantly superior to that of the control group (p -- .015). 
These results are presented in Table 5. 

Other student and teacher dat a. Student affect was measured by the 
same ten-item instrument which was used in the first field experiment. The 
data suggested that the affective reaction was similar for both groups and 
that the treatment had no meaningful impact on student attitudes. 

Reactions of the treatment teachers were assessed confidentially two 
months after the program had ended. The overall affective reaction of exper- 
imental teachers (sixteen of the teachers responded) was extremely posi- 
five. Questionnaire responses revealed that two-thirds of the participants 
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continued using all aspects of the program at or very near the initial 
level recommended by the project directors. After the program ended, ten 

y 

teachers were still including verbal problem solving in their curricula and 
thirteen were implementing the prescribed development phase at least three 
times a week. Fifteen teachers continued to assign homework a minimum of 
three nignts a week, and thirteen were conducting weekly and monthly review 
sessions. 

At the debriefing sesBion we provided control teachers with a copy 
of the program manual. Two months later we assessed their reaction to these 
materials. We did this for two reasons. First, we wanted to see how teachers 
who had been exposed to the program but who did not use it would evaluate 
it. Were the favorable comments of experimental teachers due to the fact 
that they had used the urogram and hence felt obligated to recommend it? 
We also wanted to see how new the various aspects of the program were to 
control teachers. Their responses indicated that they were familiar with 
most of the recommended teaching techniques, and two or three of the con- 
trol teachers said their supervisors had advocated that they use a direc-- 
ted lesson. Such responses suggest to us that at least in some cases, con- 
trol teachers were using parts of the program. 

Seventeen of the nineteen control teachers responded to the question- 
naire. Five control teachers reported they had carefully read the general 
manual and the verbal problem-solving manual. Five others had read both 
manuals quickly and six had at least skimmed them quickly and had thought 
about the highlights. Responses revealed that there was considerable corres- 
pondence between the teaching methods control teachers were already using 
and those requested by the program. Eight teachers reported they were 
already utiliiing the prescribed development and seatwork aspects of the 
program, and were also teaching their classes as a whole. At least five 
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more teachers reported general overlap betweeiv the program and what they 
had been doing, for each categor y except the verbal problem solving. It 
seems reasonable to suggest that the general achievement of students was 
not enhanced by the experimental program partly because control teachers 
were using many aspects of the program, although we do not have observa- 
tional data upon which to verify that point. Still, it is clear that the 
verbal problem-solving material was basically unique to control teachers 
(the new part of the present program and the part that was disseminated in 
the school system only to experimental teachers in this study). The experi- 
mental program did have positive effects upon students" verbal problem- 
solving skills. 

More detailed discussion of the teachers' positive comments about 
the program is reported elsewhere (Good and Grouws, 1979a); however, it is 
important to note that teachers generally saw the program as valuable, 
whether they participated in it or not. and that these results have been 
replicated elsewhere (Keziah, 1980; Andros and Freeman, 1981). It may be 
instructive to list some of the negative comments that teachers made 
about the treatment program. When treatment teachers were asked the free- 
response question, "What were the weakest or most confusing parts of the 
program-, five teachers said that they had difficulty using it with 
classes in which there was a wide range in student ability. Some of these 
'teachers felt the program was particularly difficult for low-ability 
pupils. Six teachers thought that there was not enough time allotted on 
a da-.ly bas.s to complete all phases of the program. In response to this 
'same question, only three control teachers listed weaknesses: it was hard 
for low achievers; there was not enougV time to complete all parts of the 
program daily; and i was hard to get pupils to do homework on a daily 
basis. In general, sixth-grade teachers were supportive of the program 
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(as had been fourth-grade teachers in the previoudv experiment) but they 
were able to report some perceived weaknesses. 

The Present Study: Experimental Work in Junior High Classes 
Considering results of the two earlier experimental studies, we were 
very much interested in expanding our inquiry to secondary classrooms. 
Unfortunately, at th^ time we were writing the proposal, there was very 
little process data which described the normative aspects of mathematics 
teaching in secondary settings. There were numerous conceptualizations 
about adolescent culture and student development, and general information 
about secondary schools (e.g., Coleman, 1961; Campbell and McSweeney, 1970; 
Metz, 1978). 

Fortunately, what data did exist were largely consistent with our 
treatment program. For example, McConnell (1977) reported that the follow- 
ing teacher behaviors correlated with student learning in high school alge- 
bra classes: task orientation, clarity, enthusiasm, and frequent teacher 
talk. These variables were very similar to the teaching behaviors we were 
testing in elementary schools. Furthermore, our emphasis on the develop- 
ment portion of the lesson also had some empirical support on the secondarjf 
level (see, for example, Zahn, 1966). ' 

Our elementary school data were also largely consistent with perhaps 
the most comprehensive source of information related to effective mathe- 
matics teaching in junior high schools (Evertson, Anderson, Anderson, and 
Brophy, 1980). In this study, intensive observational records of twenty- 
nine mathematics teachers in fifty-eight classes were correlated with stu- 
dent achievement data. The findings from this research overlap considerabii> 
with most aspects of our existing treatment program. These researchers 
found that effective instruction in junior high math classes was character- 
ized by high academic orientation, relatively more whole-group instruction, 
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frequent public recitation and discussion, active student involvement, and 
maintenance of a rapid pace. 

Their results are also consistent with our program and findings in 
other ways. Both sets of data agree that successful mathematics teachers 
are more act ive in both public (development/discussion, recitation) and 
private (seatwork) parts of the lesson. Furthermore, both research programs 
illustrate that appropriate uses of monitoring and accountability are asso- 
ciated with student achievement, and both suggest that the relationship 
between lesson parts is critical (e.g., the amount of seatwork time is less 
important than how well students are prepared for it). 

There are a few minor differences between the two sets of data. For 
example, the use of praise appears to be somewhat .more important at the 
junior high level than our research in elementary schools suggests. 

Other work in secondary schools (e.g., Stallings, et al., 1978), al- 
though not collected in mathematics classrooms, also indicates that active 
and structured teaching is practical in secondary settings. 

In the original grant proposal, we described a three-year project com- 
prised of three distinct studies. We would first conduct a treatment study 
(simply asking ir.thematics teachers to implement the existing program) and 
would use the results and the responses of these teachers ( after they had 
utilized the program) to build a modified and perhaps more sensitive mathe- 
matics program for use in secondary settings. 

In the second study, with the assistance of a new sample of teachers, 
we had planned to actively involve teachers in the modification of the 
training program. That is, the new secondary teachers would have been pro- 
vided with program material and all related findings, including the results 
of the first secondary study, and comments by previous teachers who had 
used the program in fourth-, sixth-, and eighth-grade classrooms. In the 
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third y^ar ot the study, we had proposed a retention study in order to 
determine the extent to which the treatment (of the year before) influenced 
students m their subsequent learning in mathematics. 

Unfortunately, the research program reported here had to be modified 
to be conducted over a period of eighteen months (as opposed to thre6 
years) and with a reduced budget. Several' important decisions thus had to 
be made and made rather c|uickly. Some of th'fese decisions are described, 
because they may help other researchers who will be working with practition- 
ers to think through potential problems. 

Because of the time limit, it was possible to conduct only one major 
treatment study. Since we were committed to the idea of involving teachers 
in reviewing and planning the research, the question became. Under what 
circumstances .could we do this? We found out about reduced funding in the 
summer and had to address the issue of involving teachers at that time. 
We had two al t ern|t i ves : we could work with the teachers in a very quick 
manner and be able to begin the treatment in the fail, or we could use the 
fail semester as a way to become acquainted and work with teachers and>con- 
duct the experiment in the spring semester. 

We chose the former, less-involved, partnersh ip' arrangement with teach- 
ers in order to begin the experiment in the early fall. We thought that 
secondary teachers might be less responsive than elementary school teachers 
to research (as described in the popular literature), and that once rou- 
tines (and plans) were established in the school year, both secondary teach- 
ers and students would be more hesitant about changing classroom proce- 
dures. Clearly, this assumption in itself is an empirical question and ore 
which merits investigation. 

In retrospect, we are not too disappointed with this decision. There 
are many ways in which a partnership model (working with teachers) can be 




ERIC 



20 

tested and implemented, and the context of our study dictated that we use 
a minimum model, with relatively little time for Joint decision-making and 
planning. Whether the results would be different under other conditions 
and with different samples again is a topic for future research. 

After having made the decision to begin the program relatively early 
in the year, there were still many procedural options which were available 
to us. For example, we could have had three different meetings, reviewing 
one-third of the training program at each meeting. The teachers could try 
the program for two weeks and then come back for major consolidation meet- 
ings, with the option of revising large parts of the program. We could have 
paid for substitutes so that some of the partner teacners could observe one 
jffTOther and use this information for modifying the program. We want to 
emphasize here that external constraints were instrumental in only one deci- 
sion we made concerning the design of the study. Other options we chose 
were largely our own and in retrospect, even the original constraint does 
not seem especially important because of the large number of researcher- 
teacher partnership arrangements which need to be tested. 

After deciding to test a treatment program relatively early in the 
year, we chose to use a minimal partnership arrangement wherein the time 
for involvement between teachers and researchers was relatively limited, 
but the decision-making process was still open and all aspects of the pro- 
gram were subject to change. We were prepared to spend as much time with 
teachers as necessary in order to develon a program which all participants 
were willing to implement (but only as much time as necessary). We ultimate- 
ly excluded from consideration models which would provide continuing feed- 
back to teachers (the chance to observe or to be observed by fellow teach- 
ers) or the opportunity to modify the program in major ways once it had 
been initiated. 
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We we^<^ very interested in secondary teachers' opinions of the program 
and the types and extent of modifications they would suggest. In previous 
interview work with teachers, one of us had discovered that teachers often 
have interesting explanations for their classroom behavior, even though 
they appear to be unaware of certair aspects of their behavior (Brophy and 
Good, 1974)* We also had been favorably impressed by the work that Bill 
Tikunoff, Betty Ward, Gary Griffin, and others (working at the Far West 
Laboratory) had been doing in building partnership relations with teachers, 
and had seen in draft form some of the interesting work that had been pro- 
duced by teachers (Behnke, et al», 1981)» Although we wanted to work with 
teachers tQ modify a program rather than provide resources for teachers 
to do their own research work, we were encouraged by the potential benefits 
of involving teachers in program change. 

We were also specifically interested in learning how secondary teach- 
ers would react to the program, because the recommended instructional tech- 
niques aad largely resulted from our observation of elementary school teach- 
ers. We* wanted to learn from teachers whether certain aspects of the pro- 
gram might be Inoperative in secondary classrooms. 

Prior to meeting with the teachers, we talked with Drs. Carolyn Evert- 
sop ^then at the University of Texas) and Perry Lanier (Michigan State Uni- 
versity) so that we could include their insights in potential modifications 
of the program. Both researchers were conducting larg^-scale studies with 
secondary mathematics teachers and we wanted to take advantage of their 
research experience. We did not want to provide this information to teach- 
ers in advance of our meeting because it could bias their initial impreff=* 
sions and reactions to the program (we didn't want to overload them with 
experts' opinions). However, we did intend to use Evertson's and Lanier's 
recommendations at the end of our decision-making conference with teachers, 
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if necessary ("Here is what some other people have said about the pro- 
gram.^.what do you think of the potential value of their comments?"). As 
It turned out, both researchers thought the program would be perceived by 
junior high teachers as simila-r to what they were already doing and most of 
their suggestions were related to modifying the program to fit a more 
mature and responsible secondary-school student population. Several of 
their comments about modifying the program (e,g,, the need for systematiz- 
ing evaluation standards) were not utilized because of wide variation in 
teacher opinion. Most of the suggestions which the researchers made were 
also made by classroom teachers during our meetings with them (including 
the need for common evaluative practices). 

The Planning Meeting With Teachers 

Six teachers were randomly selected to be p'&rtnership teachers from 
the volunteer sample of teachers who were willing to participate in the 
project (the sample will be described below). Prior to attending the meet- 
ing, teachers were given both the general treatment manual and the verbal 
problem-solving manual and were asked to read and critique both manuals, 
In addition, teachers had an evaluation sheet to fill out and bring to the 
meeting. We wanted to determine what each teacher thought about the program 
prior to discussion. From our knowledge of group discussion literature, it 
seemed probable that some attitudes ot individual teachers might be affec- 
ted by the particular teachers who happened to speak first or the intensity 
of the presentation of individual teachers. The raw response forms that 
teachers brought to the meeting are presented in Appendix 3, As can be seen, 
from examining these protocols, the teachers were basically supportive of 
the program and were willing to attempt to implement it when the session 
started . 
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At the beginning ot the meeting, each of the principal investigators 
made a brief five-minute presentation about tne scope of the project. Some 
of the comments by one investigator follow: "At this point, what we are 
doing IS turning to teachers, the experts in secondary education, because 
this program was developed for lementary school usage. We're very inter- 
ested in your criticisms, problems that might develop when the program is 
used in secondary schools, and we're willing to adapt it as necessary. This 
meeting is an open invitation for you to react to the program and to accept 
what appears to be useful and to revise parts that need to be changed. If 
It seems essentially workable and testable in its present form, that too 
IS okay. We really don't have an agenda other than to explore the methods 
and get your reactions about what it would take to make the program work 
in secondary schools. We are taping the proceed i ngs ... i n order to have a 
public record of what we've talked about and also to be certain that we 
remember all of the comments and suggestions that are made." 

Comments from the other investigator included the following. "We appre- 
ciate your being here and we have enjoyed previous work in the elementary 
schools. In general, this program iu the past has had good results, both 
in terms of student achievement and attitudes as well as teacher reports 
about the program. Elementary school teachers seem to be very satisfied 
with the program. I think the gains the students were making influenced 
how the teachers felt about the program and whenever students show interest 
in mathematics and make some achievement gains, that makes us teachers feel 
ROod. We're pretty excjted about movmg into the eighth-grade level. 1 
tfiink we're all aware ot the fact that there is quite a difference between 
elementary and junior high school settings. T guess that's the purpose of 
this meeting, as Tom was saying. We would really like your sincere thoughts 
;it>out parts ot the program that you think work well or your thoughts about 
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parts that might be revised as well as your recommendations about how 
we can improve the program to make it practical for use with junior 
high students. As Tom said, we really consider you to be the experts. 
You teach eighth-grade kids on a daily basis. I've taught in junior 
high in the past, but I'm aware that students have changed over the 
past few years. Without further ado, we'd like to start getting your 
comments. First, however, we'd like for you to pass in your written 
comments . " 

In other remarks we attempted to point out to partner teachers 
that though the program had worked reasonably well in elementary schools, 
we had no data base in secondary schools. In essence, we wanted teachers 
to know that we were very interested in making any and all modifications 
necessary to make the program work well in secondary schools, and that we 
encouraged their participation and especially their criticisms of the pro- 
gram. 

After we had made our remarks, one of the participating teachers imme- 
diately asked the mathematics supervisor to react to the program and to the 
meeting generally. Among other things, the supervisor said, "To be clear, 
you're working directly with the University of Missouri and the school dis- 
trict doesn't control any of the factors of the research. When I first read 
the program, my evaluation was that the components were important to what 
junior high teachers should be doing. Although teachers may not sequence 
all parts of the program like they are here, it seems similar to what many 
junior high teachers are already doing. I was kind of pleased that we went 
into the research, because it's hard to get involv^ in research where 
there are teacher variables and attempts to improve instruction. In gen- 
eral , T appreciate what they're trying to do and I think that the program 
is ti verv Kood one." 
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The mathematics supervisor was very positive (perhaps too positive) 
about the potential benefits of the program and the strong working relation- 
ship that we had shared with the school district m previous work at the 
elementary school level. We had requested a meeting with the teachers 
alone; however, the supervisor also came, and under the circumstances, it 
was awkward not to allow him to participate in the meeting. He had planned 
to be an observer only, and his responses then (and a few later in the meet- 
ing) were at the request of particular teachers. 

What effect his presence had (if any) cannot be determined. However, 
in subsequent debriefing interviews at the end of the project, two of the 
partnership teachers were explicitly asked about the presence of the super- 
visor in independent sessions. These two teachers indicated that they 
viewed (and that they thought others felt the same way) the secondary mathe- 
matics coordinator more as a friendly consultant who was interested in help- 
ing and working with them. They did not view him as an administrator whose 
role was to control teachers. Still, his presence and his expression of 
positive affect may have reduced some criticisms that teachers wanted to 
make. However, such criticisms were no^t given on the sheets that teachers 
brought to the meeting (see Appendix 5) and there is thus no evidence to 
indicate that the supervisor had any effect upon the proceedings. 

In some ways, his presence may have been useful. For example, when 
the meeting was turned over to teachers for their input, the very first 
question was, "How were we selected?". Another participant asked, "I know 
we're here, but how many schools are involved? Are all schools in the city 
involved?" The supervisor pointed out that all junior high schools in the 
city had an opportunity to participate in the project, except for some ot 
the Title I schools, which were involved in another experimental program 
on math skills. The district did not want the tw-y research programs 
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interfering with one another. He then stated that the investigators had selec- 
ted the six teachers randomly from a list of volunteer schools. 

At this point, one of the participating teachers indicated that the super- 
visor's account was consistent with her experience. She further noted, "Well, 
the day that our principal talked to us, he made participation optional on our 
part. We all kind of sat there and looked at each other and finally I said, 
*Do we need unanimous participation in our building?' and he said, 'Preferab- 
ly.' You know, by that time, we were all saying, 'Why not?*". However, at 
least one teacher felt that he/she was coerced into participation (see Appen- 
dix 6 ) . 

Group Discussion 

In general, the first few moments of the group discussion were spent talk- 
ing about general procedural events (Why were we selected?) and the history of 
the project (e.g., stating again that no work had taken place in the junior 
high with our program). Following introductory remarks by the principal inves- 
tigators and the mathematics coordinator, and general procedural discussions, 
individual teachers were asked to characterize the strengths and weaknesses of 
the program from their individual perspectives and to suggest changes that the 
g^'oup might want to consider in modifying the program. To minimize premature 
evaluations, we asked each teacher to present his or her reactions before we 
requested general corranents and reactions to the ideas which were presented. 
(We did this in part because at an earlier meeting with secondary teachers, we 
found that some teachers dominated the discussion — more on this later.) How- 
ever, it was difficult to adhere to thisr procedure and we were engaged in 
group conversation about the wisdom of certain strategies before all teachers 
had made their comments. Nevertheless, all teachers in the project did have a 
chance to present their critiques of the program before serious negotiation be- 
gan about aspects of the program which would be changed. 
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After each teacher's presentation, group discussion followed, more 
or less moderated by one of the investigators. Essentially, this dialogue 
proceeded in the following manner, "Here's a suggestion for change; what do 
you think about it; what are the advantages and disadvantages?" The deci- 
sion-making discussion seemed to perseverate on two general topics associa- 
ted with the project, but not explicitly addressed in project materials. 
One topic involved the role of testing in the program; some teachers wanted 
testing to occur on a controlled schedule and other teachers felt that dif- 
ferent topics and different types of classrooms necessitated different 
types and frequencies of testing. Some teachers were adamant that homework 
had to be graded, and other teachers felt strongly that they did not have 
sufficient time to grade homework assignments (i.e., they preferred a check- 
ing system rather than a grading system). In the end, no changes were made 
in testing or the grading of homeworK. 

The teachers strongly felt that more time should be provided for re- 
view in the junior high setting., They thought that students needed to be 
actively involved in the review process rather than that review should be 
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conducted as a totally teacher-dominated activity. Accordingly, we decided 
to extend the l:r..^._n of time allocated for the introductory phase to twelve 
minutes. Teachers also wanted to incorporate the verbal problem strategies 
into the program in a very systematic way. They emphasized that verbal pro- 
blem-solving instruction should take place every day for ten minutes, and 
that just having students work a few problems at their desks was an insuffi- 
cient strategy. One teacher pointed out, and others agreed, that teachers 
need to prepare in order to follow this program and that the verbal pro- 
blems to be solved should be determined before each class period begins. 
Verbal problems selected must be carefully interfaced with the development 
lesson which follows. Another important change which resulted from the 



f 



28 



teacher meeting was that the time recommended for homework was doubled. Tn 
elempntary schools the recommended homework assignment took fifteen min- 
utes; here, the time increased to thirty minutes. We decided that assign- 
ments should be flexible enough to allow for varied rates at which indivi- 
dual students work. Teachers could allow some students to do a portion of 
their homework in the classroom, but all students would have to do at least 
some of their homework outside class. Another program change was that stu- 
dents could now be assigned a weekly quiz as part of their broad review 
t ime on Monday. 

In general, the discussion produced many shared assumptions about what 
the program was and was not, even though some of the discussion did not 
lead to changes in the program. The modified aspects of the program and 
those parts of the program receiving most comment and discussion during 
the group meetings were summarized by one of the principal investigators 
and subsequently given to teachers for their approval and/or suggestions. 
The modifications of the program appear in the following two reports: (a) 
Teachers* Manual Addendum for Junior High Work; and (b) A New Procedural 
Summary for the Verbal Problem Solving Manual. 

Teacher's Manual Addendum for 
Junior Hi^h Work 

This addendum describes modifications for using the Mis- 
souri Mathematics Effectiveness Project Teacher Manual in junior 
high school classes. The modifications include substantive chan- 
ges aswell as minor adjustments. The changes resulted from a 
group meeting of junior high mathematics teachers who read the 
materials and then met to discuss the program. The following 
revisions reflect the collective thinking of the group. 

During the introductory phase of the lesson, a number of 
things must take place: a brief review, checking homework, and 
some mental computation. There was agreement that teachers 
should move rapidly through this phase, because there is a ten-- 
dency to spend too much time going over homework, and also be- 
cause the review at this point is distinct from prerequisite 
skills in the development portion of the lesson. However, in 
light of the additional math time available at the junior high 
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school level, it was decided to exterd the time allotted for the 
introductory phase to twelve minutes, as shown on the appended 
Time and Summary Sheet. 

The ten minutes following the introductory activities are 
designated for instruction in verbal problem solving, using 
strategies outlined in the Verbal Problem Manual. The group en- 
dorsed instruction in verbal problem solving, and several teach- 
ers pointed out that the ability to compute in isolation is of 
very little value unless students can use the skills in a vari- 
ety of situations. It should be emphasized that the time devoted 
to verbal problem solving should involve the teacher teaching 
and the students participating in class discussion. This recom- 
mendation is not fulfilled by just having the students work a 
few word problems at their desks. It was pointed out by one 
teacher that teachers need to be prepared to teach in order to 
follow this program and that this means having the verbal prob- 
lems to be used in this part of the lesson determined before the 
period begins. It was also mentioned that there is often a vari- 
ety of textbooks available at school and these can be a very use- 
ful source of problems for this part of the lesson. 

The importance of active, careful, and meaningful teaching 
of the topic for the day in the development portion of the les- 
son was affirmed. The necessity for a smooth transition from the 
development phase to the seatwork phase (where students work 
individually bn a collection of problems or exercises at their 
desks) was mentioned, along with the comment that much time 
could be lost if this transition is not carefully managed. The 
program suggests that teachers control practice in the latter 
part of the development phase; that is, teachers should have stu- 
dents work a problem like the first problem in their assignment, 
and then discuss and demonstrate its solution in front of the 
class. This procedure should be repeated several times until all 
the students seem to have the idea. This controlled practice 
helps a great deal in getting students started immediately after 
the seatwork assignment is given. 

The procedure for seatwork as described in the Teacher*s 
Manual was not changed. Teachers are to make sure that each stu- 
dent is working before providing individual help. During seat- 
work, the teacher should circulate about the room, supervising 
student work to assure that students are not practicing incor- 
rect methods. 

There was considerable discussion about how to hold stu- 
dents accountable at the end ot the p<*riod. It was agreed that 
this coul,d be done in several ways* includingt (1) calling on 
some students to give their answers to particular problems; (2) 
checking the answers to the first few proems orally (and then 
occasionally taking grades); (3) calling on students and asking 
how many problems they had finished. Jther methods are also pos- 
sible. The important thing is that students do some problems In 
class while the skills and ideas are Tresh in their minds and 
while help i*s available for those who need it. 
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There was general agreement that a homework assignment on 
Monday through Thursday was a reasonable requirement and that 
students this age could be expected to work on homework for long- 
er periods o£ time than those specified in the manual. It was de- 
cided that assignments should take 15-30 minutes. This flexibil- 
ity allows for tlie different rates at which individual students 
work and also permits teachers who like to give a combined seat- 
work-homework assignment to do so. That is, a given number of 
problems is assigned and students are allowed to work on them 
during the 10-20 minutes of seatwork in class; whatever problems 
are not finished are completed outside of class as homework. 
Under these circumstances, the assignment should be long enough 
to provide some homework for everyone. 

Several teachers mentioneti that junior high students need 
to assume more responsibility than they have previously, and 
that teachers should thus expect homework to be done on time. 
Some teachers suggested different ways of recording homework 
grades (e.g., on some days, scoring the papers and recording the 
grades, and on other days just checking off complete papers. In 
this way students would not know which procedure was to be used 
on a particular day). The way teachers handled collected home- 
work was left to the discretion of individual teachers. 

The discussion of the structured reviews every Monday cen- 
tered on how they should be conducted and the flexibility in 
scheduling them. There was agreement that the review need not be 
solely lecture, but should include student interaction in the 
f orm ^f student questions, having students go to the board, or 
having students work a review problem a't their desks with discus 
sion following. The possibility of a weekly quiz during part of 
the review time was discussed and this was deemed acceptable. It 
was decided that teachers could have this flexibility in schedul 
mg reviews, but when a review was not conducted on Monday, the 
day it was conducted should be recorded in the log. 

The timing of quizzes and tests was discussed and this 
scheduling was left to the individual teacher, with the under- 
standing that tes~ts~an"d quizzes would-be noted in the^ daily log. 

Finally, the topic of occasional variation from the time 
framework was discussed, and the consensus reached was that 
teachers should "adhere as closely as possible to the guidelines 
in order to give the program a valid test, realizing that some 
variance from the guidelines may be unavoidable. However, in 
such cases, each teacher should make a concerted effort to ad- 
here as closely as possible to the guidelines. 



Procedural Summary 
Verbal Problem Solving Manual 

The ability to solve verbal problems, or word problems, is 
an important skill. In order to insure that verbal problem solv 
ing will receive systematic attention, each teacher is asked to 
spend ten minutes of every mathematics class period on this 
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t ic. Students are thu8 exposed to verbal problem solving 
daily, even when problem solving is not the principle objective 
of the lesson. This ten-minute period should be a time when the 
teacher teaches problem solving and not a time for students to 
sit passively in their seats and work a couple of verbal prob- 
lems. That is, the teacher should actively model the solving pro- 
cess, have students work a problem, and then have a class discus- 
sion of ways to solve the problem, and so on. 

Preparing to actively teach verbal probleii solving is not 
always easy. To assist in the u^eparation of tljis part of each 
lesson, a Verbal Problem Solvingftanual has been developed. It 
details five instructional strategies which seem to be associa- 
ted with improved student performance in this ^rea. We ask that 
you use one of these strategies each day. 

The strategies in the manual can be used ijndependent ly or 
in combination. Some will be more appropriate flor particular 
problems or topics than others, and the choice jof which strategy 
to use on a given day is left to the discretion of each teacher. 
Since each of the ideas has merit, and since tlfere is value in 
using a variety of ideas, it is important to u^e each idea regu- 
larly. Whether one idea is used for a week at a time, or a dif- 
ferent idea is used each day is not important .1 To insure that 
every idea gets some exposure, we ask that each idea be imple- 
mented at least once every two weeks. ; 

The procedures outlined in the Verbal Problem Solving Man - 
uaj_ are designed to be used with textbook problems and your text- 
book will be the primary resource for these problems. Other re- 
'sources can include textbooks no longer in us,^, textbooks ^rom 
lower grade levels,' and problems based on information generated 
during class discussions, field trips, and s<j on. 

A table summarizing the key points of elch idea in the Man- 
ual is attached to aid you in viewing the prbgram at a glance. 

TFe Verbal Problem Solving Manual is tl^e detailed resource 
to assist you in the application of the ideas. 

Each teacher is asked to keep a record of the verbal prob- 
lem-solving activities used. The log should include the amount 
of time spent on problem solving, th% strategies used, the in- 
class and homework assignments on problem ^olving,and any excep- 
tions or conflicts which affect the progra^n. By exceptions «e 
mean situations which arise from time to t/ime and affect your 
schedule: shortened periods, cancelled cU'sses, holidays, test- 
ing days, and so on. Please note these occurrences in the log, 
as well as any other conflicts. The logs V/iU be collected every 
two weeks in order that progress and trea|tment implementation 
can be monitored. 
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Sununary of Verbal Problem Solving Program 
Time: Ten minutes per day, every day 
Techniques: 

Problems Without Numbers 

a) Recast textbook problems so that no numbers appear 

b) Prepare these ahead of class time on an overhead trans- 
parency , worksheet , chalkboard , etc . 

c) Focus on how to solve each problem 

Writing Verbal Problems 

a) Use graphs, charts, tables from the textbook, news- 
papers, etc. and have students formulate problem^ based 
on these data 

b) Use data from situations that arise (field trips, 
sports , etc . ) 

c) Have students supply their own data 

d) Have students solve each others' problems 



Estimating Answers 



a) Show students how to estimate 

b) Have students est'mate orally 

c) Estimate' answers to text problems before doing computa- 



tion 
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d) Eventually have students estimate answers to all verbal 
problems they work (underline estimate, circle exact 
answers) 

Reading Verbal Problems 

a) Focus on word recognition, cont^^, general comprehenS 

b) Write, pronounce, define new wofo*"; give examples and 
^ nonexamfiles- of the xoncept . - _ _ — 

c) Read problems aloud; use tape'' recorders 

d) Provide reading assistance on an Individual basis 

e) H5ive students and teacher alternately read and discuss 
problems 

f) Use text problems, student-created problems, problems 
from older textbooks 

Writing Open Sentences 

a) Translate conditions into equations 

b) Allow for equivalent equations 

c) Use i^roLflems from lover grade levels 

-* 

In many ways, it seemed that the discussion of the program led to 
some increase in teachers' willingness to implement it, but also perhaps to 
more variance in the program (in terms of individual teachers,' interpretations) 
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than was present in the previous elementary school sample. That is, group 
discussions atj-he time appear^d:^ to- suppott the notion that the recommended 
times for each part of the lesson were generalized statements about an aver- 
age distribution of time over the year, and that iruTiVidual lessons might 
deviate from the average (that not all teachers perceived the situation 
this way can be seen m Appendix 6). Alt:hi)ugh the investigators occasional- 
ly mentioned that balance among the lesson pa'rts was important, the need 
for adjustment from lesson to lesson was also frequently expressed. We sus~ 
pected that teachers in this sample would be much more likely to^modify the 
time allotments than elementary school teachers and secondary teachers who 
subsequently were to use the treatment but did not participate in the 

modification process. (However, subsequent information suggests that^the 
tight time lines presented in the manual and perhaps information given at 
the training sesrion led teachers to feel that they should not vyy time 
1 ines. ) 

^ Although there were not many alterations in the program, we feel that 
the changes made were useful and important. In addition to their substantive 
contributions, teache^rs who were involved in the discussion may have been 
very important symbolically to subsequent work with ^teachers who were asked 
to use the program. That is, the knowledge that other secondary teachers 
had examined the program may have been instrumental obtaining teachers' 
cooperation and participation and perhaps increased tHfeir adherence to pro- 
gram suggestion's. 



Outside Evaluation 

The meeting with the partnership teachers was tape recorded in order 
to allow for outside evaluation about the*,jf^dit ions and processes of that 
meeting. We were very fortunate to have the professional consulting ser- 
vices of Dr. Dee Ann Spencer-Hall, a sociologist trained in the qualitative 

\ 
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tradition (symbolic interaction) and a former classroom teacher. She is 
very interested in classroom process and has completed several field stud- 
ies in classrooms. Although she is a colleague and friend, w§ were confi- 
dent that Dr. Spencer-Hall would provide a rigorous critique of the re- 
• search and bring to the study a perspective which complimented but broad- 
ened the perspective of the principal investigators (we are pleased to 
report that our positive expectations were fulfilled). 

"Ny^Dr. Spencer-Hal l^^istened to the tape and analyzed it. She concluded 
that teachers had an opportunity to contribute ^/''The modification of the 
program and were even encouraged to do so. Howrfver, she indicated that 
teachers appeared to be stating beliefs and Suggestions which tended to 
present and support their own teaching practices rather than proactively 
dealing with the program as a means of developing an approach mathema- 
tics instruction. These were veteran teachers who in some ways seemed to be 
justifying their ourre^t teaching practices more than they were searching 
for new and integrative approaches* At a minimum, Spencer-Hall felt that 
the program did develop some common boundaries, set the conditions for mini- 
mum participation, and produced a few program modifications (although this 
' varied fro.n teacher to teacher). In subsequent interviews with the teachers 
m the program Rafter the program had ended), she found^that many teachers 
were concerned about the number of changes which were occurring in the dis- 
trict (for example, the closing of several schools and the shifting of 
teachers from one building to another), and she suggested that many of 
these factors may have led teachers to be more personally oriented than 
program-oriented during the decision-making meeting. 

0 

Context £ff* *"ts 

We were sensitive to possible context effects in the data. Another 
group of teachers might have different reactions to the program and their 
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own unique suggestions for modifying the program. This is possible 
for a variety of reasons, including the individual teachers attending 
the meeting and the nature of the district and its relationship to the 
community. Although we did not have the time or resources to examine 
these context effects directly, we did want to examine them indirectly. 
We wondered if teachers who were making recommendations about a program 
they would implement would evaluate the program differently from teachers 
who were reviewing the program but who did not have to use the modified 
program. One could argue that teachers who will teach the program would 
become much more interested in it and thought ful about it. On the other 
hand, it could be that teachers who do not have to utilize a program 
(and perhaps have to do extra work) may feel freer to make more recom- 
mendations than they wOuLd if they had to implement those changes in their 
own instructional programs. 

To consider these context effects, we met in a different city with 
another group of junior high teachers who knew that they would not be 
required to use the program. (This meeting took place prior to the meet- 
ing with users. ..the partnership meeting described above.) These teachers 
were also given both training manuals to read prior to the meeting and 
were requested to bring their critiques of the program when they attend- 
ed the meeting. (The critiques of these twelve teachers appear in Appen- 
dix 5). The teacher responses indicat' that these teachers were very sup- 
portive of the program. 

After these materials were collected, there was a discussion with 
the teachers similar to the one reported above. Teachers were asked to 
help us improve the program and were encouraged to make criticisms and 
suggestions which would make the program more practical for use in secon- 
dary classrooms. These teachers expressed much more positive affect about 
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the program during the meeting than did teachers who woul4 subsequently use 
the program. 

Spencer-Hall attended this meeting with "non-users" as an observer 
and her reactions to this group of teachers were very similar to our own. 
She noted that non-users were much more positive in describing the program 
and showed more interest in its potential value for teaching mathematics. 
She also noted (as we did) that these teachers were much more energetic, 
younger, and more knowledgeable (at least more expansive) in their discus- 
sion of mathematical concepts and instructional strategies. In general, 
both the principal investigators and the outside consu It ant /evaluator felt 
that this group of non-users would have been much more enthusiastic in 
their implementation of the program than the other group. However, it is 
impossible to determine whether our beliefs would have been matched by 
actual behavior. At a minimum, these data suggest that the modifications 
suggested by teachers were reasonably consistent across two different sam- 
ples and that the condition of teaching or not ti^ching the program did not 
appear to mediate suggestions (although affect and involvement did vary 
between the two groups). 

As noted above, Spencer-Hall had access to the tape recording of the 
"user" meeting and had observed the "non-user" meeting. The following sec- 
tion presents her comments about these two groups of teachers (her comments 
have been condensed and edited; however, she has approved the present ver- 
sionK It should be noted that when Spencer-Hall wrote this report, she 
had interviewed several of the "user" teachers and hence her comments are 



^In general, the questionnaire reaction of both user and non-user 
teachers to the treatment program was very favorable. For a comparison of 
-jser and non-user responses as well as pre-post changes in user teachers' 
reactions to the program, see Appendix 5. 
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based on these interviews as well as on her information about what trans- 
pired during the two group meetings. ^ 

Spencer-Hall's Comparison of the Two Samples 

In comparing information from meetings between the non-user 
and user teachers, I have discussed two types of differences be- 
tween these groups. First, I think there were some differences 
in individual characteristics between the two groups of teach- 
ers. There were also some differences between the two school dis- 
tricts which influenced teacher participation in the program. I 
should point out that because I do not have individual data from 
'the non-user teachers, my comments are based on observations of 
their general meeting in the fall of 1979. (If I had interviewed 
some of the non-user teachers, my comments would be more defini- 
t ive . ) 

The non-user teachers generally appeared to be much younger 
than the user teachers. I am not suggesting that age differences 
would have affected teachers' evaluations and use of the pro- 
gram, but that the older us^er teachers had a more negative atti- 
tude toward students and their teaching, which reflected a dis-- 
enchantment and pessimism developed over many years. Some of the 
general problems related to teaching which were expressed by non- 
users were associated more with the general , problemat ic nature 
of teaching (e.g., filling out papers, managing five or six 
classes of adolescents a day, etc.); whereas users tended to 
link teaching probl'ems to a perceived change in students of to- 
day. Most of the user teacher . hought that students today were 
out of control for various reasons: were from homes of former 
hippies; watched too much television; were from "broken" homes; 
or were directly or indirectly influenced by drugs. This percep- 
tion of students probably made users* teaching less enjoyable 
and less effective. Non-users did not blame students and/or par- 
ents for classroom problems. As I said, perhaps the older teach- 
ers have seen negative change over a longer period of time. The 
younger teachers may not have such a historical perspective and 
thus they are not able to compare today's students to students 
of fifteen years ago. 

The two groups of teachers also had contrasting perspec- 
tives on change. The non-user teachers were supportive, enthu- 
siastic, and positive about the program because it offered the 
possibility for change which might make their teaching more ef- 
fective, and they seemed willing to take steps toward that 
change. On the other hand, the user teachers seemed more resis- 
tant to change. Most of them said they did not alter their teach- 
ing at all when they used the program, that it reflected what 
they had always done. This resistance is of concern for several 
reasons . 

The results of the study were probably affected if user 
teachers d^d not really change their instructional programs. 
(Was what experienced teachers have always done being measured. 
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or the instructional procedures outlined in the program?) The 
investigators may also have had some misconceptions about what 
teacher behaviors should be changed and how. If user teachers' 
prevailing attitude was that they need not change from their old 
ways, perhaps they were automatically denying that certain as- 
pects of their, behavior did need to be changed. Even when user 
teachers agreed to participate in the study and were well paid, 
they ignored the possibility for change. 

Most of the user teachers did not take work home; this find- 
ing was different from what teachers in mv other studies have re- 
ported. For example, last w^ek I interviewed a math teacher who 
estimated that she spent up to thirty hours a week outside class 
grading papers, etc. Non-users* questionnaire responses would 
allow comparisons between their outside preparation and that of 
users. 

Comments made at the meeting suggested to me that the mor- 
ale of user teachers was generally lower than non-users' morale. 
Differences in conditions between the two school systems may 
explain this variation. We can safely assume that all school sys- 
tems are suffering the same structural problems, which are due 
primarily to economic factors. However, the users' district was 
experiencing these problems to much greater extent than the non- 
users' system. The combination of economic problems, declining 
enrollment, and desegregation had caused disruption to the whole 
user district, particularly to the junior highs because of 
school closings. User teachers were thus primarily concerned 
about whether their particular schools would stay open and if 
not, what this would mean to their future careers. School clos- 
ings were particularly threatening to teachers who had about 
twenty years experience, and had been looking forward to a 
smooth transition into retirement. I believe this was a dominant 
concern among the user teachers, one wh i,ch overrode their commit- 
ment to participation in the study. In comparison, non-users 
worked in a more stable and more affluent school system. Al- 
though contact with school administrators in the non-users' dis- 
trict can provide more information about this phenomenon than I 
can, non-user teachers did not mention school district problems 
as a concern which affected their commitment to teaching or to 
the program. 

The pervasive organizational-systemic-financial problems 
and pressures on the user teachers, and their generally negative 
attitudes towards students and teaching, were predominant fac- 
tors which probably affected their commitment to the study. The 
non-user teachers, who were less concerned about these kinds of 
problems and had a more positive attitude about students and 
teaching, exhibited a more enthusiastic response to the program. 

There were some areas of concern which the two groups of 
teachers voiced about the program, although I am certain these 
criticisms are ref'-cced more clearly in their responses to the 
questionnaire. A major criticism was with the lack of flexibil- 
ity they perceived in the program. This concern may have been 
partly due to teachers' interpretation (incorrectly) that they 
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could not vary from the tin^e schedule at all in order to fulfill 
the requirements of the study. Secondary schools follow very dif- 
ferent and more rigid time schedules than elementary schools, 
and secondary teachers found it difficult to implement the pro- 
gram (or predicted it would be difficult to implement) when it 
did not fit into their ongoing time schedules (this difficulty 
also reflects a certain rigidity on the part of both users and 
non-urers). Furthermore, at the secondary level class periods 
are frequently interrupted by other activities: assemblies, 
class meetings, etc. Investigators can hope that teachers will 
be flexible enough to work around disruptions, but often they 
are not. Perhaps a more realistic alternative would be to build 
flexibility into the math progr; 
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Another common criticism was that the program was not prac- 
tical tor use with lower-level students. This complaint was also 
voiced.,by teachers who participated in another study (Keziah, 

In summary, non-user teachers were enthusiastic, suppor- 
tive, and positive about the program. I should point out, how- 
ever, that three teachers made most of the comments. Three- 
fourths of them made some comments, and three teachers said noth- 
ing. Although user teachers seemed positive about the program 
because it was similar to what they had been doing for years, 
they had a negative attitude about teaching in general and a per- 
vasive concern about the future of their school system and their 
own positions in the system. 

In conclusion, the relative success of the math program is 
m part a reflection of teachers' attitudes about teaching and 
their students, and the degree to which their school systems are 
experiencing difficulties. Implementing the program is not pure- 
ly a matter of changing instructional procedures. 1 feel that 
had the program been implemented in the non-users' district, stu- 
dents' achievement gains would have been greater. Students in 
districts such as the users', where teacher morale is low and 
populations are rapidly shifting, are at a disadvantage, even 
when their teachers utilize the best programs. 

An examination of the planning comments which "non-users" were asked 
to make at the end of the Teaching Style Inventory (teachers brought these 
to the meeting) indicated that most "non-user" teachers reported that they 
spent large amounts of time planning at home (all but one teacher spent 
from U - 2^ hours each night). Hence, this and many other differences 



Also (as noted earlier) a few sixth-grade teachers cited this as a 
weakness of the program. However, our analysis of achievement findings do 
not show systematic problems for low achievers. 
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between the two teacher groups have been noted. What effect, if any, such 
differences would have on program implementation is, of course, impossible 
to determine. Howi>ver, such data suggest that the context of the research 
site in teacher partnership work is very important. Furthermore, the teach- 
er interview data collected by Spencer-Hall and those collected by Good and 
Confrey (to be described later) will help to illuminate the difficult condi- 
tions under which some teachers work. Such data also indicate how those con- 
ditions (and teachers' perceptual reactions to them) affect what can and 
cannot be accomplished through in-service programs. 

Method 

Sample 

The research look place in a large Southwestern city. The investiga- 
tors met with school administrators during the summer in order to explain 
the project and to obtain permission to do the study. School administrators 
explained the project to principals, who in turn described the project to 
classroom teachers. All junior high schools in the district were contacted, 
except for several Title I schools which were participating in another math- 
ematics experiment. The school administration felt that two experiments 
within the same school would be unwise and we agreed. 

In some schools all eighth-grade teachers volunteered for the project; 
in other schools, only one teacher volunteered. After determining the num- 
ber of teachers who would be participating in each school, we again dis- 
cussed the sample with the school administration. We wanted to balance the 
sample as closely as possible according to the schools that control and 
treatment classes came from. Because we had to meet with partner teachers 

' We also asked our observers to interview user teachers about outside 
class participation (see Appendix 7). These results also indicate that user 
teachers did little outside class preparation. Also, the observers wrote a 
brief sketch of each teacher. These profiles ap^^r in Appendix 8. 
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early in the year, it was impossible to derive the sample after the adminis- 
tration of the pre-test (the best research strategy). Based upon informa- 
tion the school districts gave us about the student population each school 
served, we divided the sample into matched sets of schools, and randomly 
assigned schools to treatment conditions. 

Nineteen teachers volunteered for the project. Of these, six were 
assigned to the partnership group and five teachers were assigned to the 
treatment Rroup. Both the partnership teachers and the treatment teachers 
were asked to use the instructional program in their classrooms. The only 
difference between the two groups was that the partnership group had a 
chance to modify the program, and the treatment group did not. 

Five teachers in the control group allowed us to observe their class- 
rooms. Three other teachers in the control group allowed us to observe and 
to collect pre- and post-achievement data in their classrooms, but did not 
attend the orientation training (we called these teachers non-participating 
controls to distinguish them from the control teachers who received a moti- 
vational treatment). 

The nineteen teachers were drawn from twelve different junior high 
schools. Most of the target classrooms in the study were regular eighth^ 
grade classrooms. However, because one partnership teacher who was basical- 
ly teaching algebra suggested at the partnership meeting that it would be 
interesting to compare algebra classrooms as well, we did build a minor, 
pilot algebra study into the design. The distribution of regular eighth- 
grade classes and eighth-grade algebra and ninth-grade algebra classes 
sacross the entire sample was as follows: partnership teachers, ten, one, 
and three; treatment group teachers, seven, zero, and two; regular control, 
nine, three, and one; non-participating control, five, zero, and zero. The 
final sample is summarized in Table 6# 
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Teacher Trainin g 

Two weeks after the initial meeting with the partnership teachers, 
the project directors met with sixteen of the teachers from the twelve 
schools, the school principals, and district administrators. At the train- 
ing workshop, all participants were told that the program was largely based 
upon earlier observation of relatively effective and in-effective fourth- 
grade mathematics teachers. Furthermore, we explained that subsequent re- 
search in fourth- and sixth-grade classrooms had provided experimental data 
to illustrate that students in classrooms of teachers who had been exposed 
to the treatment did better in some areas of achievement than did students 
in control classrooms. We also told participants that a group of junior 
high teachers from their own district had been working with us to modify, 
and hopefully to improve, the program. Teachers were informed that they 
were going to be requested to teach t t modified program. 

Teachers were told that although we expected the program to work, 
the earlier correlational/experimental work had been conducted in elemen- 
tary schools, and the present project was the first test of the program 
in secondary schools. After a brief introduction, the teachers and their 
principals were divided into two groups. Teachers in the treatment group 
(including both partnership and regular treatment teachers) were given an 
explanation of the program (the training lasted ninety minutes). After the 
training session, regular treatment teachers received the 45-page manual, 
along with instructions to read it and to begin to plan for implementation 
(partnership teachers already had read the manual). In this manual, defini- 
tions and rationales verc presented for each part of the lesson, with de- 
tailed descriptions of how to implement the teaching ideas. In addition, 
treatment teachers were also told what modifications were made by the 
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teachers at the planning meeting and also received the verbal problem- 
solving manual and the more precise procedural directions which had been 
developed by teachers at the partnership meeting. 

Control teachers were told that they would not receive details of the 
instructional program until later in the year, but that we hoped this infor 
mation might be especially useful to them then. At that time they would 
receive information (i.e., other teachers* comments) about the program it- 
self. Finally, we informed control teachers that their immediate role in 
the project was to continue to instruct in their own styles. Because the 
control teachers knew that the research was designed to improve student 
achievement, that the school district v^as interested in the research, and 
that they were being observed, we feel reasonably confident that a strong 
Hawthorne control was created (as noted previpusly, three control teachers 
did not attend this orientation meeting). 

Thej partnership teachers were paid $200 for their pa?:ticipation in 
the project, all other teachers were paid $100. Teacher honorariums were 
paid for att/anding workshops and for filling out logs of their teaching 
activity. At the end of the project, all teachers who agreed to an inter- 
view, who provided a critique of the SRA test, and who filled out another 
teacher belief instrument were paid an additional $100. 

Observat ions 

Control and treatment teachers were observed approximately ti/elve 
times during the study. Each classroom in the project was observed four to 
seven times depending on the number of classes the teacher had in the 
study. If the teacher had three or four classes, then only four or five 
observations were made in each of the teachers* classes. If the teacher had 
only one or two classes involved in the study, then each class was observed 
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Six times. Each observer conducted approximately one-half of the 
observations in each of the classes and observations in each class 
were equally spaced throughout the duration of the study. 

All observations^were made by two doctoral students in mathe- 
matics education who were living in the target city during the project. 
The observers were trained initially with written transcripts and video- 
tapes, and then in actual classrooms- Observers reached reliabilities of 
• 80 on each of the codinjg distinctions used in the actual study. The class- 
room observational form J the observational checklist, and the content logs 
filUd out by control afd treatment teachers (biweekly) can be found in 
Appendix 9. 

r 

Schedule for Meetings and Testing 

The initial meeting with partnership teachers took place in late 
September and the training/briefing session with all the teachers was 
held during the first week in October. Pre-tests were administered in 
the second week of October and classroom observations began shortly there- 
after. The post-test was administered in January; hence, the treatment 
lasted about three months. The mathematics pre-test had been used in the 
Texas Effectiveness Project and was provided to us by Dr. Carolyn Evertson. 
The post-achievement tests were two subtests of the SRA, Level F, Form 1 
test (Math Concepts and Problem Solving). Reliabilities on both instruments 
are excellent. These instruments can be found in Appendix 10. The Aptitude/ 
Attitude Inventory used was the same Instrument we had used in our previous 
work in elementary schools (for detailed information on this instrument, 
see Ebmeier, 1978). This instrument can be found in Appendix 11. Also in 
Appendix 11 is the Teaching Styie Inventory that was used to assess teach- 
ers' beliefs about mathematics. 
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Program Implementation ! 

Teacher opinions * After terminating ttie project, we wanted to obtain 

1 

teachers' perceptions of their involvement in the program. We felt that 

i 

it would be useful to have someone else collect these data for us, and as 
reported earlier, Dr. Dee Ann Spencer-Hall was willing to do this. She 
traveled to the target city about a month after the project had been con- 
cluded, and interviewed all six of the partnership teachers and three of 
the five treatment teachers (she also interviewed two of the control teach- 
ers, but those data are not relevant to the present discussion). t 

The interviews lasted about one hour; a fev of them had to be conducted 
via phone (because of an ice storm). Dr. Spencer-Hall described herself 
as a former teacher and as a sociologist interested in ideas people have 
about teaching. She indicated that although she wanted to ask several ques- 
tions about the project, she was not one of the project staff and simply 
wanted to know what their reactions were to the program. She stated that 
criticisms were welcome. 

At the conclusion of her interview work, she drafted a brief summary 
for the project directors. A very condensed and edited version of her com- 
ments (which has been read and approved by her) follows: 

In retrospect, I think the interviews went quite well. Most 
of the teachers appeared to be open and honest with me in their 
responses. I plan to give you feedback in two ways. First, I 
have enclosed the interview schedule, the questionnaire I used 
(with modifications depending on which category a teacher was 
in), summaries of each teacher's interview, and my own subjec- 
tive reaction to the interviews. Second, I am having the tapes: 
transcribed because I feel that many comments were worth having 
verbatim and in their entirety. 

At this point, I would like to make a few subjective com- 
ments. My first reaction to the teachers was that they were all 
very experienced. ^or example, five of the eleven teachers have 
taught twenty years, two have taught over fifteen, and the re- 
maining four have taught over twelve years. The range of twelve- 
twenty years, with the mode of twenty years gives you an inter- 
esting sample. I realize you will get this data from the ques- 
tionnaire you had them fill out, but the thing that struck me in 
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the interviews was that (a) three of the five who had taughV 
twenty years were obviously burned out on teaching, and (b) four 
of these five were sure that kids today have "gone to the dogs." 
(Although some in the over fifteen year range expressed the same 
attitude.) My opinion is that such dissatisfaction with teaching 
and the attitude that kids today are disturbed, of low ability, 
and generally hyper and out of control affects these teachers^ 
effectiveness — and ultimately, in this case, reduced their enthu- 
siasm for trying something new, i.e., your program. 

A more important consideration, however, also seems to be 
related to the large number of years of experience. Most of the 
teachers felt that because of their many years of experience 
they had learned or developed the most effective way of teach- 
ing. This attitude was also reflected in the fact that six of 
them said they did absolutely no preparation outside of class, 
three did only fifteen-thirty minutes, and two spent over one- 
and-a-half hours a night. Those who did none were even incredu- 
lous (they all laughed hilariously) that I would suggest that 
they had to prepare. I suppose their reasoning was that anyone 
who has taught the same subject for fifteen or twenty years at 
the same level must be completely incompetent if he/she has to 
prepare for classes. Because of the pervasive attitude that they 
were teaching math in the most effective way possible, the pro- 
gram may have done little to change their behavior. 

In summary, as I said before, these comments are subjective 
and only somewhat systematic at this point; they only relate to 
general areas and concerns. The interviews, however, did rein- 
force and substantiate my own opinion that the data should be 
contextualized. Even though the data are primarily quantitative, 
your methodological strategies have taken you into the qualita- 
tive area, through partnership Information discussions and my 
open-ended interviews, and thus more consideration should be 
taken of the contextual features of day-to-day life in the 
schools and classrooms. For example, what about the context of a 
si^th-grade class is different from an eighth-grade class and 
would make implementation of the program more problematic for 
eighth-grade teachers? The situational context in a junior high 
is probably more disruptive, more complex (due to size, for exam 
pie, and having six or seven different classes), has more con- 
flicts, and is less predictable (in terms of events and individ- 
ual behaviors). This would partly explain the teachers' dissatis 
faction with the routinized nature of the program; it does not 
realistically reflect the "reality" of the junior high world. To 
reiterate my Oj^inion, classroom events occur in complex, problem 
atic situations and in contexts which impinge and sometimes in- 
hibit classroom routines. Cannot these contextual factors be 
integrated into discussions and even into the programmatic as- 
pects of teaching math? (The result would surely be a book.) I 
will save further comments for later and will look forward to 
any reactions from you and to future discussion. I am thoroughly 
enjoying my participation. 
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Brief summaries of partner and treatment teachers' reactions in the 
Spencer-Hall intervj.ews are presented in Appendix 6. However, these are 
only a small portion of the total interviews. The interview schedule she 
used included the following questions: 
I. School 

1. What is it like to teach in this school? 

2. What kinds of things inhibit what you do in your class- 
rooms? .Problems which interrupt your work? 

II. Teaching 

1. How do you feel about teaching, i.e., how satisfied are 
you with teaching-^s an occupation? (Probe) 

2. What things might happen to increase your s'atisf action? 

3. What bothers you most-least about teaching? 

4. Do you think teaching math i^^any different from teach- 
ing any other subject? (How — in what ways?) 

5. Do you teach differently in different math classes; in 
the same course at different hours of the day? (Why — 
How? ) 

III.j Math Ef f ect ivenes^s Program 

1. To what extent do you feel you*ve become involved in the 
program? 

2. Did you change anything about' the way )^at you*ve taught 
math as compared*to past years? (What — How?) 

3. Do you see this as a positive change — is your teaching 
more (or less) effective n^w? ^ 

4. What do you see as^ the ma^jor strengths of the program? 

5. Weaknesses? (Why)' 

6. If you could chainge the program in any way(s) what would 
you do? (Why) Addit ions«^Deletions? 

7* Would you (continue) tc-ijse it if changes were made?' 
8. Did you communicate with other teachers about the pro- 
gram? (How, what happened?) 

IV. Relationship to Researchers 

1. Did you feel you had adequate jljfiput into the program dur^ 
ing your early discussion with the researchers?' 

2. Did you feel you had an impact .. .that your comitients and 
suggestions were taken seriously? 

3. What (if anything) could have been done to have made com- 
munication with the researchers more effective or* help- 
ful? 

4. What is your general feeling about classroom teachers 
and researchers working together on Instructi , .idl pro- 
jects? (Probe) 

r 

V 
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V. Outside School, 

1. What do you •Bo when you^re not at school? 

2. How much of your time outside school is spent in plan-' 
ning for your time ^inside school? 

3. Did participation in this program change your planning 
time outside school? (How?) 

We are presently analyzing these interviews to determine teachers' 
beliefs about general cts of teaching, and to see if these beliefs can 
be related. in any way to effects on students. These analyses were delayed 
because we anticipated collecting interviews which were more specifically 
focused upon the teaching of mathematics (these were collected and will be 
discussed later). We did not want to be influenced by previous knowledge 
ab;jt teachers (previous interview responses; knowledge about teachers' 
effects upon student achievement; etc.) when these interviews were conduc- 
ted. 

Our own analysis of the teacher interview responses to questions about 
program implementation is that the responses approximate a bell-shaped 
curve. One partnership teacher (01) had especially strong negative feel- 
ings. This teacher reported that the i rogram had no effect upon her/his 
behavior and th^at he/she felt coerced into participating in the experiment. 
The observers f^U that the teacher implemented the program at a minimum 
level despite these reactions. Another teacher (03) reported compliance 
with certain aspects of the program, but observe-s found virtually no in- 
volvement ana/or participation in the study. Other teacher comments about 
the program in -^neral were reflected in observational data (to be dis- 
cussed later). For example, one teacher (02) who liked the program because 
of the verbal problem-solving strategies did emphasize verbal problem solv- 
ing in the classroom. 

Four partnership teachers reported that they liked the meeting and 
that the introductory meeting with researchers and the subsequent training 



session went welK Two of those who approved of the program pointed out 
specific parts tnat were good; the other two emphasized the similarity be« 
tween their own teiaching and the present program. Similarly, the treatment 
group had a mixed reaction to the program and to the research training ses~ 
sion (they did not participate in the modification session) • 

Both groups of teachers reported that the program was similar to what 
they were already doing and indeed, Drs* Lanier and Evertson had mentioned 
this possibility to us previously, suggesting that it was both an advantage 
and a disadv^jitage • It was an advantage in the sense that teachers would be 
willing to implement the program and to make some modifications in their 
behavior • However, teachers might not be motivated to look for some of the 
subtle (but important) differences between the program and their present 
teaching methods. 

One year after the project ended, fifteen of the participating teach- 
ers were interviewed (to be described later). Although teachers were not 
explicitly asked about their reactions to the treatment program, all treat^ 
ment teachers initiated on their own some comments about a part icular part 
of the program which was meaningful to them. Some teachers said that though 
they had been conducting class review sessions in the past, the program had 
prompted them to think systematically about the nature of review and how 
they could build broader reviews into the lesson. Other teachers indicated 
that the program had helped them to consider instruction in problem solving 
and to emphasize this topic more than they had. Some participants commented 
.that their general approach to development and seatwork assignments was 
very siiTiilar to the approach advocated by the program, but that they were 
now much more careful to be certain that students were ready for seatwork 
before they assigned it. In general, teachers did not make comments about 
the program as a whole; rather, they chose to comment upon particular parts 
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which seemed especially meaningful to them. We suspect that teachers were 
surprised by the general similarities between the experimental program and 
techniques they had already been using in the classroom. The contrast be- 
tween their expectations tor the program and the actual program may have 
made the similarities (and hence their reports of them) highly salient. 
However, their behavior during the program (as we shall see below) and 
their comments at the end-of-pro ject interviews suggest that some teachers 
were noting and responding to subtle differences between their teaching 
pract^-es and program recommendations, at least in some areas of the pro- 
gram , 

Observer research . An initial step m analyzing data was to determine 
the extent to which partner and treatment teachers had implemented the pro- 
gram. Because participants reported that the program was similar to instruc 
tional methods they were already using, it was important to determine 
whether treatment teachers and control teachers differed in any systematic 
ways m their classroom behavior (i.e., was the treatment condition associa 
ted with some distinctive teaching behavior'^). 

Table 7 presents selected implementation data for all project teach- 
ers. The first six teachers are partnership treatment teachers. Teachers 
seven throut^h eleven are regular treatment teachers, who were asked to 
implement the program and were trained to implement the program, but did 
not have d chance to modify the program. Teachers twelve through sixteen 
were control teachers who attended the orientation meeting and who were 
observed. As noted before, there were three other teachers who served as 
controls, and who were observed but who did not attend the orientation meet 
iHK (these control teachers were called non-participating). 

Our first task was to examine the implementation scores to determine 
if partner and re>iular treatment teachers were usmg the program. From just 
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the variables presented in Table 7, it is clear that some teachers imple- 
mented the program more fully than did others* The average implementation 
score (more on this below) is based upon the five variables presented in 
the Table, as well as several other variables (including the assignment and 
checking of homework, the presence of controlled practice, the presence and 
quality of revipw work, etc.). 

The information presented in Table 7 allows the reader to see the vari- 
ability between and within treatment and control teachers on selected as- 
pects of the program. 

A general implementation score was assigned to each teacher at the 
end of each observation. The score assigned to the teacher was based on the 
following scale: 

(5) If the teacher implemented all major components; 
(4) If the teacher implemented most of the major components; 
(3) If the teacher implemented about one-half of the program 
components ; 

(2) If the teacher implemented some of the progra'n coinponents; 

(1) If the teacher implemented very little of the program. 

Innercoder reliability was estimated on the implementation scores on 
the basis of seven dual observations made in the target school district 
during the first two weeks of the study. Perfect agreement was found on 
five of the seven observations and only a one point variation found for 
each of the other two observations. 

At the end of the study, a comprehensive implementation score was 
determined fpr each teacher, by averaging on the individual implementation 
score assigned to the teacher at the end of each visit. These means are 
reported in Table 7. 
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One important question to raise is, does degree of program implementa- 
tion correlate with residual gain in computation, problem solving, and 
attitudes toward mathematics? To answer this question teachers * average 
implementation scores, average time spent on mental computational instruc- 
tion activities, and average time spent on verbal problem-solving activi- 
ties were correlated with students' residual scores for computation, prob- 
lem solving, and attitude. These results are presented in Table 8, 

As can be seen in Table 8, the averag'ft implementation score does not 
correlate significantly with students' residual performance on the computa- 
tional or problem-solving test. However, average implementation score was 
found to correlate significantly with students' attitudes to»«?ard mathe- 
matics (p - .02), 

The correlation of instructional time spent on mental computational 
and instructional time spent on verbal problem-solving activities are also 
presented in Table 8, These parts of the program were computed separately 
because they were presumed to be relatively novel instructional acts (not 
frequently engaged in during secondary mathematics instruction). 

As can be seen in Table 8, the average time spent on mental computa- 
tional activities did correlate significantly with students' problem-solv- 
ing residual scores (p .03), but not with their computational scores nor 
attitudes toward mathematics. Interestingly, instructional time spent on 
verbal problem-solving activities did correlate significantly with stu- 
dents' residual scores for computation (p - ,05), problem solving 
(p .02), and virtually reached a significant relationship with students' 
attitudes toward mathematics (p = .09). 

An examination of Table 7 shows that partner and regular teachers were 
found to implement some aspects of the program more often than did control 
teachers. The ment'^I computation and verbal problem-solving activities 
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differentiated the tv/o samples ^nost sharply, and there was consider- 
abla overlap between treatment and control teachers in terms of the 
amount of time spent on development and seatwork, and in the overall 
quality of the development lesson. Overall, these data suggested that 
somewhat different behaviors were occurring in treatment and control 
classrooms and hence, an analysis of achievement effects would be mean- 
ingful (especially in the area of problem solving). 

After examining the implementation data, we decided to eliminate 
teacher three from subsequent data analyses because this teacher was 
generally deficient in implementing the program*. In particular, this 
teacher did not utilize the mental computation activities and virtually 
ignored verbal problem solving throughout the course of the experiment. 

Observer opinions . At the conclusion of the project we asked the 
two observers to describe briefly each teacher they had observed and to 
provide their general impressions of the teachers, their effectiveness, 
and the extent of their program implementation. The two observers' com^ 
ments appear in Appendix 8. In general, their comments reflect important 
variations among teachers in the extent to which features of the program 
were present in control and treatment classrooms. Observers' comments also 
generally support the implementation data derived from actual observational 
records ♦ 

All in ail, the implementation data from three perspectives suggest 
that treatment teachers generally saw tne program as quite similar to 
teaching techniques they had been using p^-eviously. However, there is 
evidence that treatment teachers were influenced by the program, and that 
they did instruct in a manner which differed in some ways from control 
teachers. The data further suggest that teachers were more influenced by 

N 

certain aspects of the program rather than the treatment as a whole. The 
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verbal problem-solving techniques and mental computational activities 
appear to have had most impact upon treatment teachers. 

Results 

After deciding to eliminate teacher three from all analyses dealing 
with program effects on students (because of this teacher's low implementa- 
tion score), two general questions affecting the analysis of the data were 
considered. First, we wanted to know \' the algebra teachers in the treat- 
ment and control conditions differed in any way (it was assumed that alge- 
bra students would do better than non-algebra students on the post-test). 
This analysis showed no differences between the algebra teachers in the 
treatment and ccr-.rol classrooms (the p value for pcst-computat ion was .71; 
the p value for post-probi-em-solving was .34; and the p value for post- 
attitude was .80). Next we wanted to determine whether the partnership 
teachers differed from regular treatment teachers, and if these groups 
should be analyzed separately. These comparisons suggested that there were 
no significant differences between partnership and regular treatment teach- 
ers. The respective p values were: post-computation, .50; post-problem- 
solving, p = .91; and post-attitude, p - .42. The effects of partnership 
and treatment teachers were not different. 

As can be seen in Table 9, the pre-ach ievement level of students in 
the control group was somewhat higher than achievement levels for treat- 
ment classes. Despite this, raw scores of students in the treatment group 
on both the p'ost-computation and the post-problem-solving sections of the 
SRA achievement test were somewhat higher than scores of students in con- 
trol classrooms. Analysis of covariance procedures (using the prescores »s 
a covariate) were performed on the adjusted means shown in Table 9. In per- 
forming these analyses, the classroom was used as the unit of analysis and 
each class that a control or treatment teacher taught was included as a 
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separate unit in the analysis (N = 39)* The results of these ANCOVA analy- 
ses indicated a weak trend in favor of the treatment^ group on the c^^^ 
tional performance of students (p = •15)* However, the effect of the treat- 
ment on problem-solving scores of students was significant (p - .03). These 
results are^consistent with the implementation data reported earlier. That 
is, there was not much variability in general behavior between treatment 
and control teachers; however, there were noticeable differences in the use 
of mental computation activities and verbal problem-solving activities. 

Follow-Up Teacher Interviews 

One year after the formal project had ended, arrangements were made 
to interview available classroom teachers. Sixteen cf the teachers who had 
participated in the project were still teaching in the school district, 
and it was possible to interview fifteen of them. 

Dr. Dee Ann Spencer-Hall had interviewed many of the teachers when 
the project concluded; her questions focused upon teachers* reactions to 
the project and their general beliefs about teaching and schooling. The 
present interviews dealt specifically with the teaching of mathematics and 
teachers' beliefs about mathematics teaching. In combination, the two^ sets 
of interviews should provide an integrated picture of t^e beliefs that 
these secondary teachers had about teaching generally and about mathematics 
teaching. 

In conducting these interviews, we were fortunate to have the profes- 
sional consulting services of Dr. Jere Confrey at Michigan State University 
Dr. Confrey is a former secondary mathematics teacher and is a specialist 
in mathematics content at the secondary level. She has also done extensive 
field work involving methods of interviewing students and teachers. She is 
presently working with Dr. Perry Lanier and others at Michigan State Univer 
sity on an intensive study supported by funds from the National Science 
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Foundation* Their 'research examines students' experiences (and their concep- 
tualizations of mathematics content being taught to them) in junior high 
general mathematics clasVes* DrT'Confrey assisted both in the conceptualiza- 
tion the interviews and in the data collection. Some of the interview 
questions resulted from the National Science project at Michigan State Uni- 
versity. However, many of the questions raised were developed specifically 
for our own research project. 

All of the individual follow-up interviews were conducted by Drs. Con- 
frey and Good. Some of the teachers were interviewed jointly so that we 
could experiment with the interview format. The questions presented in the 
interview follow: 

What subjects do you presently teach (number of sections of 
eighth-grade math/ algebra)'^ 

When and why did you decide to become a mathematics teacher? 

What is the difference between seventh- and eighth-grade math 
content (the difference between eighth- and ninth-grade math 
content ) ? 

List the various units that are taught in eighth-grade math. 

Do you spend the same amount of time on all units (why or why 
not)'' ^ 

Why is math taught in schools? Why, in particular, is eighth- 
grade math taught? 

What's the most important content that you teach? 

If students just learned two or three things, what things would 
you want them to learn in your class? (Does it differ for differ- 
ent students or groups?) 
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Which content do you spend most time on? Is this because it's 
hard? Important? Or prerequisite for other material? 

How do you decide when to move from one unit to another? Do you 
ever re--teach lessons? How often? Why? 

How much flexibility do you have in choice of content and pace 
of instruction'' Does the district mandate the content of a cur- 
riculum'^ 

How much do you know about what other teachers do in eighth- 
grade mathematics? (In your building. . .across the district). 
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Are there some areas of disagreement concerning content or teach- 
ing style? 

What makeB students work hard in mathematics? 

How important are grades in motivating students? 

On what basis do you assign grades? (Effort vs. performance; the 
role of tests, homework, and behavior)? 

How much stress do you place on application? More for some stu- 
dents than for others? Which ones? 

How important is memorization vs. understanding mathematics? Is 
it more important for some students than for others? How do you 
define memorization and understanding? 

Do all students do equally well in math? Why not? 

From your experience, are the highest-achieving and lowest- 
achieving students (say, the top and bottom one-fourth of your 
class) closer or farther apart at the end of the year in terms 

of their mathematics ski lls? Why? How do yoji feel about this? If 

you wanted to change it, what could be done? 

What percent of your eighth-grade students are capable of master- 
ing the basic curriculum? 

How do you teach the concept of ratio? How do you teach multipli- 
cation of decimals? Take the problem .7 x .11 and explain. In 
working this problem, if a student asked, "But I thought when 
you times something, the answer gets bigger," how would you re- 
spond? 

If there was sufficient time in the interview, the following questions 
were asked: 

In elementary school, the subject of reading is often taught In 
groups, but math is more typically taught to the whole class — 
why does this happen? How do you feel about it? 

Most teachers say that they have good teaching days, so-so teach- 
ing days, and bad teaching days. What's your opinion about this? 
What makes a good day? Has this changed over your teaching 
career? 

The following questions were asred of all interviewees. These questions 
were .taken from the gAeral mathematics* project being directed at Michigan 
State University by Dr. Perry Lanier, 

- Mark each statement either true or false. 

In mathematics, there can never be more than one right 
answer. 
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Problems without answers exist in mathematics; not just 

problems that no one has answered yet. 

An answer in mathematics is always either right or wrong. 

If there were no people in the world, mathematics would 

still exist. ^ 

- If you had a choice, which of the following would you prefer 
when solving a problem: 

to have one method which works in all cases. 



to have more than one method which works in all cases. 



to have more than one method which works in some cases. 



Why? 

' Is it possible to get a right answer to a problem in mathema- 
tics and still not understand the problem? Explain. Is it more 
true of some students than others? Which ones — what percent of 
your students is this true of? 

- Is it possible to understand a problem and still not be able 
to get the right answer? Explain. 

- Below are eight statf»ments which describe mathematics. Rank 
the statements which oest describe mathematics from 1 (best 
describes math) to 8 (least describes math). 



Rank 



1. 


Mathemat ics 


i s 


like 


a bag of tricks. 




2. 


Mathemat ics 


is 


1 ike 


building a model airplane. 




3. 


Mathemat ics 


i s 


like 


playing the lottery. 




4. 


Mathemat ics 


is 


like 


doing chores. 




5. 


Mathemat ics 


is 


like 


following a recipe. 




6. 


Mathemat ics 


is 


like 


composing a song. 




7. 


Mathematics 


IS 


like 


flirting with a sweetl^eatt. 




8. 


Mathemat ics 


i s 


like 


telling th"e truth. 





- Check the following activities which you consider as part of 
mathemat ics. 



DoinR fractions. 
Constructing a jigsaw puzzle. 



59 

^ - Changing decimals to p^rcents. 
Thinking about infinity. 

Making change for dollar bills, 

Thinking through a verbal puzzle or riddle. 

Finding areas. 

Playing chess. 

Balancing a checkbook. 

Thinking about space. 

Solving equations. 
Computer prograniming. 

Calculating statistics. 

Handing in homework. 
These data were collected in the spring of 1981 and the typed trans- 
cripts are now being analyzed. We expect to integrate these analyses with 
other data sources in the project. As mentioned previously in the text, we 

will include these results in a monograph now being written by Drs, Good, 

•* *, 

Grouws, and Ebmeier. 

Appropriateness of Student Achievement Measure 

As a result of the teacher interviews it was possible to examine the 
adequacy of the achievement test from the perspective of classroom teachers. 

The reliability of the SRA (Level F, Form 1) mathematics test is excel- 
lent; however, one can still raise questions about validity. We wondered to 
what G*igree the test overlapped with the material teachers taught in class 
and the types of problems presented in textbooks. We attempted to obtain 
this information in two different ways. 

First, we asked Dr. Jere Confrey to conduct a content analysis to com- 
pare the SRA test with the Holt School Mathematics text (the book most used 
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in the sample). Her interesting comparisons introduced a number of ques- 
tions about the adequacy of the test in certain areas (especially general 
computation). Dr. Confrey's complete report appears in Appendix 12^She 
raises some important concerns about the problem-solving test and the text 
(the test is a narrower definition of problem solving), but concludes that 
there is a reasonable congruence between the general text and test (the 

largest discrepancy occurs between the test and the chapter in the book 
devoted to problem solving). Her comments raise a number of interesting 

issues about matching text consent and test problems. 

When the fifteen teachers were interviewed a year after the project 

ended, they were given a copy of the SRA test and were asked to critique 
€ach test* item (Was it taught? Was the question asked appropriately?). All 

teachers subsequently returned the test ratings by mail. Their responses 

generally indicated satisfaction with most of the test items, with only 

two teachers (one treatment, one control) having strong negative reactions 

to the test. 

Although problems exist with the match between test and instruction, 
the test appeared at least minimally adequate for making comparisons. Also, 
the test appeared to be equally appropriate for treatme'rit and control teach- 
ers (as indicated by teacher responses and by our examination of teacher 
legs). 

Research in Progress 

We'are still analyzing some of the data collected in the project. As 
noted previously, interviews with project teachers focused upon their gener- 
al reactions to teaching as well as their specific reactions to mathematics 
teaching. We plan to relate teachers' general beliefs about teachinfe and v 
speciMc beliefs about mathematics to their classroom behavior and to the 
achievement gams of students. The second set of Lntervlews was collected 
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in March of 1981; the interpretation of these data is under way and 
will be reported in Good, Grouws and Ebmeier (in progress). 

In addition to teacher interview data, we also have fourth-, 
sixth-, and eighth-grade teachers ' responses to the same 73-item 
Teaching Style Inventory (Appendix 11), This comparison across grade 
levels should help us to determine whether teachers ' .general beliefs 
about mathematics teaching practices are influenced by grade level and 
by experience or educational background. 

Furthermore, we also have data from' large samples of iourth-, 
sixth-, and eighth-grade students on the same 6l-item mathematics Apti- 
tude/Attitude Inventory (Appendix 11), This comparison of students at 
different grade levels should yield a meaningful profile of the extent 
(and type) of change in stu^nts' beliefs about, and preferences for, 
certain mathematical practiced. These data will also be presented in 
Good, Grouws, and Ebmeier (in progress). 

Although not a formal part of this project, two dissertations were 
completed that have some relevancy to the work reported here and these ♦ 
studies were supported with a smalL amount of project money. These stud-- 
ies were completed by the two observers in the project, John Engelhardt 
and Rathanne Harre* Brief accounts of their work can be found in Appen- 
dices 13 and 14 and extended discussions of their research are in their 
dissertations (Engig1lTirrmrr^980; Harre , 1980). 

Englehardt's ^research was conducted in sixth-grade classrooms us- 
ing ^only the verbal problem-solving treatment. His data suggest that 
this treatment when used without the larger and more general Missouri 
Mathematics Program (^oes not have powerful effects on students' verbal 
problem-solving skills. • ^ 

Harre research was conducted in eighth-grade mathematics class- 
rooms and examined the time-on-task behavior of students in treatment 
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and control classrooms. Her data show that students in treatment classes • 
were coded tor more apparent involvement than were students in control 
-roups. These data suggest that part of the general effectiveness of the 
Missouri Mathematics Program may be because it enhances student attention. 

Discuss ion 
Previous Research: Elementary Schools 

The research presented in this final report is based on two research 
pro^^rams supported by previous grants from the National Institute of Educa- 
tion, The earlier research influenced the present study in substantial 
ways; it therefore seems appropriate to preface the discussion of the pre- 
sent study with a brief explanation of the context of previous research. 

Because of the failure of both educational research and general inter- 
vention strategies (not based upon research) to generate meaningful under- 
standings of classroom practice, we decided to observe teachers who were 
making a difference in student achievement (students' mean residual achieve- 
ment gam) in a particular context (fourth-grade mathematics). We felt that 
meaningful variation in teaching behavior did occur and we wanted to test 
this notion, as well as our general belief that individ.ial teachers make 
a ditference m student learning. Our original intention was not to build 
a comprehensive mathematics prpgram, but to test the hypothesis that teach- 
ers at feet student learning. 

..e chose a standardized achievement test as an operational defini- 
t : oa of teacher effectiveness. Although this is not a complete definition 
of tf'acher e n f ect i vene ss (or even an adequate definition), we do feel 
that it IS one aspect of teaching which is important. Standardized achieve- 
ment scores can he a partial criterion if one understands their limitations 
.in'! 'loes not over-generalize findings based upon fchem. 
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The initial study provided evidence that stable and relatively high 
and low "effective" teachers could be identified, although many teachers 
fluctuated from year to year in their "effectiveness" (as measured and esti- 
mated by the mean residual gain of their students on a standardized achieve- 
ment test). From behavioral observation of high and low teachers, it /was 
possible to identify patterns of teaching chat differentiated these 'two 
groups of teachers. These findings were supported by research elsewhere in 
field settings and by previous experimental research in mathematics educa- 
tion, as well as by observers* comments about instructional variables in 
the naturalistic study. These findings were ultimately integrated into a 
progri»m for training and research purposes. 

In our first experimental study, w^ found that fourth-grade teachers 

I 

were able to implement the program afte^ minimal training (some trouble 

j 

was experienced in the development portion of the lesson) and that implemen- 
tation v/as associated with student achiJjvement gains. Because the differen- 
ces in test scores between treatment and^ control classrooms were large, 
and because the actual treatment was only two-and-a-hal f months ip duration 
(hence, relatively cost effective), the re$ults suggest that the program 

is a reasonable method of mathematics instrt^ct ion . Also, the results (both 

\ 

on the standardized test and the test designed to match the content teachers 

s \ 
I 

actuary presented) clearly show an important ^ teacher effect in these inner- 
city school classrooms, which suggests that successful educational inter- 
ventions are possible. However, it was found ths^t the treatment program 

was better for some combinations of students and teachers than for others 

\ 

(achievement of all combinations was higher in treatment conditions, but 
this effect was large only for some combinations). 

In the second experiment^bl study, we developed' a problem-solving stra- 
tegy designed to improve students* ability to work verbal problems which 
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appeared in elementary textbooks* Although the project staff felt that 
this detinition of problem solving was a very limited one, we did accept 
the fact that this was the problem-solving curriculum for many students 
and teachers. We thus built a program that was designed to affect this 
type of mathematics performance. 

In developing the program, we found virtually nothing in the 
literature to describe what teachers' views are of problem solving and 
what they do when they teach such content. It is important that future 
research natural ist ica 1 ly study teachers during problem-solving instruc- 
tion, to determine whether some teachers are more adept at such instruc- 
tion than others. Unfortunately, in this project we»did not have the time 
or resources to do this important exploratory work. Instead, we built a 
proi^ram based upon recommendations that were available in the literature 
and we integrated this advice with our own thinking. 

We tested this new training manual in combination with a manual 
that had been developed in the previous experiment (in fourth-grade 
classrooms) in sixth-grade classroon^ in the same school district. 
Pre- and post-tests indicated that the program had a significant effect 
upon treatment students' verbal problem-solving skills. However, the 
program did not have a significant effect upon general matheij^at ics 
achievement; probably because the general manual was commonly available 
m all schools (after the successful field experiment in grade four, ail 
fourth-grade teachers in the district were given inservice training in 
the program). In addition to this possibility of general "contaminat ion 
comments made by some control teachers during debriefing procedures indi- 
cated that they were familiar with parts of the general program that 
are not routinely found in elementary school curricula (e.g., mental compu- 
tations J • 
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Finally, it should be noted that the success of the treatment in the 
second field experiment was moderated by the form of general administrative 
organization of mathematics teaching (math as special subject, semi^depart- 
mentalized, or open plans). The results of the program are therefore some- 
what dependent upon teacher type, student type, and administrative organiza- 
tion, as well as on the treatment per se . 

The combined results of our work in elementary schools suggested that 
meaningful improvement in students' mathematics achievement was possible 
and that Che pr'jgrams which we had developed were reasonable intervention 
strategies, at least under certain conditions. With this experience, we 
moved into secondary schools. 

Treatment Effects: Secondary Level 

The data collected in the project indicate that change in teacher 
behavior and in student performance in secondary schools is possible. In 
particular, the results demonstrate that participation in the treatment 
program was associated with a significant positive effect upon students' 
problem-solving skills, as measured by the SRA test. Although neither of 
us thinks that the problems in this test are a completely adequate measure 
of problem solving, they do represent some skills that appear to be impor- 
tant. It IS therefore edifying to see that treatment teachers had a positive 
effect upon student performance on the problem-solving subtest. 

Although we have raised some questions concerning the adequacy of the 
content criterion test and the level of teacher implementation, the overall 
evidence suggests that treatment teachers did implement more prob 1 em~so 1 v- 
ing strategies than did control teachers and that the test was a reason- 
able mea-sure of content being presented in classrooms. We can thus confi- 
dently say that the program had a positive effect on treatment teachers' 
implementation and students* performance on the test. 
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The data also reflect a moderate, positive trend favoring treat- 
ment students' post performance on the computational subtest of the 
SRA inventory. However, because the difference iSs minor, it is prob- 
ably appropriate to state that the training program had no notable im- 
pact upon this type of student achievement. This appears to be the case 
because both treatment and control teachers taught in similar ways during 
the developmental portion of their lessons. The qualitative ratings which 
observers made of all teachers are not high and indicate that much future 
research needs to focus upon conceptualizing and implementing the develop- 
ment stage of the lesson. Although some teachers in treatment and control 
classrooms were able to conduct development successfully, most qualitative 
ratings of implementation were not uniformly high. 

The teacher interview data are still being analyzed, and from 
these data we may be able to make statements about the relationship be- 
tween teacher beliefs and teaching performance, and their effects upon 
students. These results will also lead to a fuller understanding of the 
perceptions that secondary teachers have about teaching mathematics and 
the conditions under whicti they teach. In particular, interview data will 
make us more sensitive to some of the difficulties involved in attenpts 
to change teacher perceptions and behavior and will also make us more 
aware of the difficult circumstances in which some teachers teach. The 
principal investigators are presently working on a book with Howard 
Ebmeier (Good, Grouws, and Ebmeier, in progress) and more extensive in- 
formation about the teacher interview data (the general interviews con- 
ducted by Or. Dee Ann Spencer-Hall and the interviews which focused spe- 
clfically upon mathematics teaching, conducted by Drs. Tom Good and 
Jerp ronrr*^> ' will be discussed in this publ'ication. 
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Working With Teachers 

We began our program of re'search several years ago by observing what 
"elementary teachers (who were more and less successful in obtaining student 
achievement) did in the classroom and by building a training program that 
was sensitive to those differences (although it included a few other compo- 
nents as well). In the present research we attempted to adapt this program 
for use in secondary schools by working with secondary teachers. 

We found that the opportunity to work with teachers to modify our pro- 
gram was an interesting and valuable experience. In retrospect, we would 
have done some things differently. In particular, we now feel that it would 
have been more appropriate to have spent considerably more time on proce- 
dural aspects of the study than we did (e.g., what the observations were 
for, how they would be used, when results would be provided to teachers, 
etc* ) . More time spent on procedural and social interactions before initia- 
ting a focused, decision-making discussion with teachers would have been 
advantageous. Some initial formal contact with teachers should take place 
before any substantive discussion, and such meetings should probably give 
teachers more information about the research and lessen some of their per- 
sonal concerns about observation and involvement. Such procedural orienta- 
tion should take place before teachers are asked to read the manual; later, 
when they have read the manual, they might critique it more fully on sub- 
scant ive grounds. 

Another procedure which we woul modify involves the initial contact 
with teachers. Because of the geographical distance involved in this study, 
this initial contact was made by school administrators. We made some assump- 
tions about the amount of procedural information teachers possessed; how- 
ever, we found that some teacriers did not receive all the information that 
we thought ha^i been coTranunicated. Also, when working with volunteer teach- 
ers, it would be very helpful for investigators to contact teachers and 
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to allow teachers to agree (or disagree) about participation and to nego- 
tiate general collaborative arrangements* Some teachers appeared to have 
volunteered, but without an affective commitment to participation. Investi- 
gators could meet with a large group of potential teachers, engage m 
social and procedural interactions, and only then allow teachers to make i 
a decision about their participation* 

In retrospect, the present treatment/discussion meeting may have been 
too demanding. That is, the teachers were requested to comment upon al_l 
aspects of the program at a single meeting* If we were repeating the study, 
we wo'ild instead hold two or three different meetings* At the first meeting 
only development and work on modifications ot that aspect; of the program 
would be discussed. In the second meeting seatwork, review, and homework 
program components would be considered. Such arrangements might lead to 
a more focused and more thorough evaluation of the program. If problems 
developed, it might be usef^ul to have yet a thiVd, fol low-ufi,meet ing to 
resolve some issues. For example, in the present study, teachers in general 
had strong teelings that the testmc; procedures should be systematized, 
b^ut thev had widelv varying ideas about 'how to do this* In retrospect, it 
seems appropriate to form teacher committees which attempt to develop tenta- 
tive solutions. Such committees could bring their work back to the whole 
^^ro'up ror discussion, review, and modification. 

Manv otner changes are also possible in the partnership arrangements; 
however.. the wisdom and desirability ot additional strategies depend upon 
rhe particular problem being investigated and the types of generalizations 
which teachers and researchers are trying to make. If investigators are 
tryin'4 to get maximum teacher involvement, it probably is important to bring 
,n videotapes of teaching (particularly tapes which focus on the develop- 
ment Dortion ot the lesson) and to al lovi teachers to Jointly critique and 
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review program components. Teachers could also observe and be observed by 
fellow teachers in the partnership group so that they could develop fuller 
understandings of the program and improved strategies for implementing it. 

As the data indicate, teacher reactions are likely to vary from site 
to site (for a variety of reasons), and one critical factor that would have 
to be considered in any partnership work is how to balance the many demands 
teachers already face with new demands imposed by project participation. 
Some teachers would Appreciate increased opportunities to interact with 
other teachers and to discuss the program; however, other teachers may 
react negatively to extended or involved arrangements. Indeed, it is impor- 
tant for these procedural issues to be resolved by researchers and teachers 
'jointly at their initial meeting so that a common set of expectations about 
time required for participation (as well as the form of suth participation) 
could be developed. 

Because of the context in which we worked (especially time con- 
straints) and the limited amount of time we spent- meeting with teachers, 
we are reasonbly pleased with the level of teacher involvement obtained 
and the Ideas which were incorporated into the program. Several program 
modifications were made, and we think that these changes were appropriate 
and important for adapting the program to secondary schools. These ideas 
were essentially teacher-initiated, and we are grateful to the partici- 
pating teachers for their input and assistance. Teachers' brief involvement 
in training did appear to alter certain aspects of some teachers' behavior, 
and increased their involvement in the project. However, project involve- 
ment did not have a positive effect on other teacijers. These individual 
variations among teachers are similar to results reported by Ebmeier (1978) 
in the elementary school project. Some teachers in' that study implemented 
the program more fully than others. In particular, Ebmeier found that 
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proKram implementation was higher among teachers who felt that they were 
already teaching in ways recommended by the program, and by teachers who" 
were searching for new alternatives. The brief partnership and the general 
training procedures which we utilized in this study would appear satisfac- 
tory for obtaining program implementation from such teachers. However, tor 
teachers who are not interested in seeking alternative solutions and who 
feel that the program is contrary to their teaching styles, more elaborate 
procedures and more time will probably be necessary. 

Future Research 

Development lesson . In our work in elementary schools we found that 
many teachers do not regularly use an extended development component in 
their mathematics lessons. The treatment appeared to be helpful in elemen- 
tary schools because it increased the amount of time elementary school 
teachers were utili/.mg for development, and it thus helped them to bec'ome 
more active in their teaching of mathematics. However, we found that most 
secondary teachers regularly include/a development portion in their lessons 
and that time, per se, is not as important as is the quality of develop- 
ment. If irr-provement s are to be made in teachers' instruction during devel- 
opment, -It seems important to generate more adequate procedures for convey- 
ing to teachers criteria which can be ysed to estimate the quality of the 
development phase of their lessons. As a beginning step, we are making some 
films so that teaching and training in development can be more accurate and 
nore specific in the ''uture. 

More content-tocused development needs to be emphasized in future re- 
search efforts. Although the program provides general strategies for teach- 
ing: mathematics, particular content needs to be studied more thoroughly. 
Better concept -la 1 i /at i on of the instructional demands of different t%pes 
ot mathematical content is needed and information about how the development 
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porti^on oh tfie lesson can be adjusted in ways that are consistent with 
changes m content. Although the purpose of the program is not to develop 
generic lesson plans, it is designed to encourage careful thinking anS anal 
ysis by individual teachers. In its present form, the program does not do 
enough to promote critical thought about different types of mathematics 
rnntent or about which strategies are more or less appropriate for teaching 
different types of content. Time allocations suggested m the program 
should probably vary with different types of mathematics content, as well 
as aTccording to the lesson stage. The same sensitivity to variation should 
be built into the observational coding system and checklists which are used 
tor classroom observation. Both the program*s instructional strategies and 
observational procedures need to be more closely related to content issues 
m the teaching of mathematics. 

Teacher variation . We began the program of research about a decade 
ago in order to answer the question. Do individual teachers make a dif- 
ference in students' learning during mathematics instruction? It was not 
our intention to build a perfect mathematics program, but rather, to 
determine whether teachers had an effect on students' achievement and/or 
r3ttitudes. Usinj^ strategies derived from naturalistic observation of suc- 
cessful elementary teachers, we wanted to see if other teachers could use 
these behaviors in their own teaching and to estimate what impact, if any, 
these behaviors had on student achievement. In our subsequent work we have 
become more interested m improving students' mathematics performance and 
m f^elpmg teacher? to develop broader strategies for teaching mathematics. 
AM have emphasized strict time allotments for each lesson component m 
order to have comparable procedures for evaluating the impact of the pro- 
^T'Vn on students. Although the ^ener.il time allocations are practical (tor 
example, the relative amounts of development and seatwork ) , we feel that 
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,the distribution of time and emphasis on particular lessons may vary great- 
4y. That is, the Iramework id an average or generalized approach to teach- 
ing mathematics. It is now time to explore these instructional variations 
more fullv, particularly in terms of the different types of mathematics 
content being presented. 

The collective results of studies in our research program as 
well as those obtained elsewhere (Stallings, 1980; Anderson, Evertson 
and Brophy, 1979; Evertson, Anderson, Anderson, and Brophy , 1980; Pro- 
gram on Teacher Effectiveness, 1978) provide evidence that general training 
programs cafi have impad^ upon meaa^ la ssroom performance. However, there 
are sutfioient data to suggest that general treatment progfams are apt to 
have different levels of iitipact on different types of teachers and students 
Uanicki and Peterson, 1981; Ebmeier and Good, 1979). Such results call >:^r 
both a need to understand why programs affect l^ifferent combinations of 
teachers and students in different ways and to develop procedures for devel- 
oping more differentiated instructional programs. 

We are pleased that our training program has had some success. 
However, it is important to reiterate that different teachers, various 
organizational structures, and diverse types of students have interacted 
in various ways with the program to affect the pattern of results. Much 
more information is needed about how these context conditions influence \ 
the program and the^ways in which the general strategies and structures ^ 
can be calibrated to fit into particular contexts. 

Theory . Past research has shown ^hat teachers vary m their behav- 
lOr and m their effects on students. It is now time to syntncsize the 
findings from our research program and research elsewhere, and to identify 
models tor studying particular contexts. We must also learn how* to adapt 
mathematics lessons to individual students and to particular types of 
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contt^nt. Howt^ver, as noted in Appendix 2, such a synthesis of empirical 

studies will be very complex. To guide the, synthesis of present results, 

to direct future research, and to gain insights into mathematics teaching, 

we will need to develop new theoretical constructs. 

Since tlie Missouri Mathematics Program focused on whole-class instruc- 

t4onr. It is difficult to speculate about its effects on particular learners 

or tor particular content. Nevertheless, it might be instructive to present 

some hypothetical comments about why the Missouri Program has appeared to 

work at a general level. These ideas have not yet been tested, but hopefully 

will be topics of future research. The following comments are taken from 

Good (in progress). 

...We have evidence that the Missouri Mathematics program in 
general had positive impact upon the mean performance of stu- 
dents in experimental classrooms, but we have no data to explain 
why the program worked. I suspect that the program had an impact 
because many elementary school teachers simply do not emphasize 
the meaning of the mathematical concepts they present to stu- 
dents, .and they do not actively teach these concepts. Too much 
mathematics work in elementary schools involves some brief teach- 
er presentation and a long period of seatwork. Such brief expla- 
nations for seatwork do not allow for meaningful and successful 
practice of concepts that have been taught/ and the conditions 
necessary for students to discover or use principles on their 
own are a\lso lacking. 

It Seems plausible that the emphasis in our program upon the de- 
velopment stage of the lesson leads teachers to think more deep- 
ly about the concepts that they are presenting and to search 
more activel> for better ways of presenting those concepts to 
students. Furthermore, given the way in which the development 
stage of the lesson is conducted, the program of instruction 
should ailovy teachers to see students* errors before they have a 
chance to practice those mistakes for a long period of tune. 
This feature of the prcgram seems to be especially desirable be- 
cause some research has suggested that it is very difficult for 
students to t"eti~^^arter5~rhat they do not understand instruc- 
tion. The clear development lesson would help students to under- 
stand more fully the concepts that they must master and how 
those concepts are related to oth«r concepts that they have 
learned. The development phase of the lesson thus helps both 
teachers and students to develop better rationale for learning 
^ activities and to develop a sense ot «. ont i nu i ty . 



There is some recent research evidence to < 1 lustrate that students 
are more attentive in treatment than control c las^^es (Harre, 1^80). 
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The controlled practice portion of the lesson aids both teachers , 
and students m understanding whether the basic concepts and 
mechanics are being understood. Such information especially al- 
lows teachers to correct and to re-teach aspects of the lesson 
so that students develop appropriate conceptual understandings 
and skills prior to sustained practice. Also, it itf hypothesized 
that students would be much more active thinkers during the. de- 
velopment and controlled practice portions of the lesson. This 
is because students know that seatwork and their homework are in- 
timately related to these activities, H6nce, successful under.-' 
standing during controlled practice leads to successful seatwork 
and successful homework. Checking of seatwork allows teachers ' 
one final opportunity to correct misunderstandings prior to the 
assignment of homework. Following successful practice, bri^f 
homework assignments should offer students p'ositive learning' ex- 
periences that both provide for better integration of 'material 
and also the development of more appropriate student attitudes 
about mathematics and their ability to learn it , -In particular, 
students will probably conclude that increased peAonal effort 
during mathematics instruction leads to positive learning ej^peri- 
ences. Students would thus be presenting more positive feedback 
to teachers about mathematics instruction (e*g,, handing in com- 
pleted homework and exhibiting positive verbal and non-verbal 
behaviors during mathematics instruction, which in turn increase 
teachers' expectations that they can present mathematics effec- 
tively, leading to renewed efforts on their part to carefully 
structure the mathematics lesson). 

The preceding statements are only a few of the beliefs and hypo- 
theses that we hold about why the mathematics program was work- 
ing. It is important to note that these hypotheses need to be 
tested if we are to develop more adequate understanding of the 
antecedent conditions necessary for successful mathematics learn- 
ing. For example, research is n'eeded to determine 4f in fact ex- 
perimental teachers identify more student errors and can more 
readily understand those mistakes duringxthe development stage 
than do control teachers who use dif f erent\t€:.^hing techniques. 
It would be equally important to determine whether st>udents in 
experimental classrooms are more active th-inkers during- the de- 
velopment portion of the lesson than are students in control 
classrooms f perhaps by asking students to prob»lems immediate- ^ 
ly after the development portion of the lesson). Similarly, more 
research is needed concerning the conditions under which student 
errors are developmental ly helpful and lead to increased student 
effort to integrate material, rather than debilitating and con 
vincing students that they do not understand mathematics. When 
teaching effectiveness studies begin to examine their embedded 
assumptions by stating and testing the specific ways in which 
student learning is influenced, the conditions under which teach- 
ing and learning strategies are useful will become clearer than 
they are at present. 

Clearly, these comments are meant to explain why the mathematics pro- 



working in elementary schools. We need to consider the contextual^ 
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ditterences between teaching in elWmentary schools and teaching in second- 
ar> schools, to include such contextual differentiations in our theoretical 
thinking, and to begin to test these theoretical notions. Investigators 
must consider the perspectives of teachers, students, and researchers as 
they formulate theories and cesigi? studies. Historically, res^rch on teach 
in^^as tended to emphasize one set of variables at the exfjense of others. 
For example, sometimes detlailed clinical interviews are condiicted with stu- 
dents, but classroom observat ionV of those students are not made, and teach- 
er opinions about what •was taking plac0 during instruction are not meas~ 
uYed. If we are to increase* understandings of ciassroor|i learning, it will 
be necessary to incorporate the more immediate responses of teachers and 
students into the design of classroom re^arch — one beginning effort is pre- 
sently under way (Confrey and Good, m progress). 

« 

lategratipg research paradigms . Although our research began with an 
attempt to identify what "effective' teachers did in the classroom, we do 
not believe that this is necessarily the best wa^^ to understand teaching.* 
We telt at the time that little was known about what takes place during in- 
struction in elementary school mathematics and we wanted to understand the 
phenomenon more fully. 

We used a quantitative procedure for this purpose, and we think that 
^such idrge-~scale research may be useful for identitying interesting sources 
of naturalistic variance (e.g., teacher behavior, student behavror, student 
outcomes, etc . ^ whicli may be worth investigation. For example, mathematics 
educators are v^if^ interested in -problem-sol ving behavior and. "sol ut ions" 
tor imptovmg instruction are frequently offered, yet we have no mf orma-- 
1 1 on about what teachers do when they are teaching probleSi solving. 

We know from our own data that some teachers who )c,ro4^p students for 
instruction m mathematics have*very positive effects on ^udents, as 
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measured bv standardized achievement tests. Because our research design 
focused upon the '•extreme performers'* in our sample (most of whom happened 
to be wholr-class or Large-group teachers), we cannot describe how more and 
less "effective" small-group teachers varied in their behavior. There are 
probably many other important questions that can be addressed effectively 
by quantitative/naturalistic procedures. However, experiences and outcomes 
that many would like to see occurring in schools, but which do not present- 
ly exist m natural practice, would require changing behavior, not merely 
stud\irii^ It natural istical ly (Good, 1980). 

Quantitative strategies are useful for identifying potentially inter- 
esting classroom practices (although in some cases the "surface" exposed by 
such strategies may be misleading), and for describing such practices in 
rough outlines. However, quantitative strategies seem to be a poor metho- 
dologv for explaining classroom patterns. Researchers interested in theory 
and in the design of instruction to fit a particular context will have to 
explain d\namic patterns of pupil and teacher responses and their mutual 
adaptation. Qualitative strategies are better for addressing such issues as 

social lan^,uage m learning, the subjective interpretations of teachers and 

I 

students, nei^otiated meaning, and reciprocal eftects of classroom partici- 
pants fsee tor example, Florio, 1979; Erickson, 1977). 

Qualitative strategies offer no guarantee of increased understanding 
of classrooms. All too often in qualitative research investigators study 
onlv a fp^' aspects ot the environment in great detail while other varjables 
P^^tfentldl: attectmtr. classrooms are ignored. If new theories and more dif- 
ferentiated instructional programs are to emerge, more comprehensive and 
mteii^rdtive strategies \ M have to he utilized. In new research efforts, 
quantitative strategies may be used>to associate problems with an appro- 
pr!ite Srir^le. For example, an investigator interested in the polarization 
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ot fuuh- and low-achieving students in American classrooms might want to 

use quantitative s1*ategies to determine whether there are classrooms wliere 

low-achieving students do not fall further behind high-achieving students 

as the year progresses. If such classrooms exist, they would provide an 

interesting contrast to classrooms in which increased polar izatior\ does 

occur. Atter potential samples are identified (and quantitative strategies 

would otten be useful for this purpose), then quantitative and qualitative 

methodologies could be used in combination to explore the problem. We are 

f 

clearly advocating that researchers match their research strategy to the 
problem being studied. We are also suggesting that research become nore 
integrative. It seems unfortunate that research focuses upon social learn- 
ing or academic learning; or upon students 0£ teachers; or upon management 
or instruction. 

' A| potent 1 a I ly useful approach at this time would be a more comprehen- 
sive study ot the major aspects of classrooms simultaneously (teacher per- 
ception and behavior; student perception and behavior; curriculum content; 
social learning). As the scope and breadth of studies increase, it may also 

be advantageous to increase tho range ofc cooipetencies that individuals 

t 

brink; to the research task. Individual experts can work on various aspects 
ot a lart^e stud^. Obviously, there are limits to the number ot variables 
vhich can be included m a single study and only certain aspects oi class-; 
rooms can be examined, even with large amounts ot time and money. 1here 
are also problems m securing and maintaining working relationships in 
cross-discipline research teams. However, despite these prol)lenis, it seems 
: 4>ortant for researchers to study more classroom variables than thev have 
m the past. One means b^ which such expansion of research night take place 
lb a cross-d 1 sr i p ) 1 ne research team whose individual members share a c omm 1 1 
T^ent to a common research proble.i, e^'en though they hdivt different methodo- 
lo/,ical and :>ubstaritiv'* skills and insights. 
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Table 1 



Sutnnary of Key Instructional Behaviors* 

Daily Review (First 8 minutes except Mondays) 

a) review the concepts and skills associated with the homework 

b) collect and deal with homework assignments 

c) ask several mental conputation exercises 

Development (About 20 minutes) 

a) briefly focus on prerequisite skills and concepts 

b) focus on meanina and proT,oting student understanding by usinn lively 

^ explanations, ce- ons trations . process explanations. 1 1 lustratu.n; . a... 

c) assess student ccrprehension ^ 

1) using process/product questions (active interaction) 

2) using controlled practice 

« d) repeat ar-! elaborate on the meaning portion as necessary 

Seatworm (About 15 rnnutes) 

a) provide uninterrupted successful practice 

b) momentum - keep the ball rolling - get everyone involved, then sustain 
invol verr.ent 

c) alerting - let students know their work will be checked at end of penod 

d) accountability - check the students' work 
Homevtf)rk Assignnent 

^ assign on a regular basis at the end of each math class except Fndays 

b) should involve about 15 minutes of work to be done at home 

c) should include one or two review problems 

Special Reviews 

a) Weekly Review/tlai ntenance 

1) conduct during the first 20 minutes each Monday 

2) focus on skills and concepts covered during the previous week 

b) Monthly Review/Maintenance 

1) conduct every fourth Monday 

2) focus on skills and concepts covered since the last monthly review, 
neachcrs were also requested to slightly Mck up their pace through the tcxtb.ok 
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Table 2 

Mean Percent of Occurrence of Selected Implementation Variables 
for Treatnent and Control Grouo Teachers and the Correlation of 
These Variables with Te-"'hers' Residualized Gain Scores on the 
SRA Mathem^ Test, Field Experiment I 



Treatment Con_trol 
X, 



p-Value^ Correlation p-Value 



1. Did the teacher conduct review? 

^. Did developr^ent take place within 
review? 

3. Did the teacher check homework? 

4. Did the teacher work on mental 
cor^.putaticn? 



5. Did the te = c"-3r si 
day's materials? 



".arize previous 



6. There v/as a slow transition from 
review. 

7. Did the teacher spend at least 5 
minutes on development? 

8. Were the students ^eld accountable 
for controlled practice durjng the 
development phase? 

9. Did the teacher use demonstrations 
during presentation? 

10. Did the teacher conduct seat\/ork? 

11. Did the teacher actively en^qe 
students in seatwork (first Ih 
minutes) ? 

12. Was the teacher available to pro- 
vide itr,mediate help to students , 
curing seatwork (next 5 minutes)? 

13. Were students' held accountable for 
seatwork at the end of seat\/ork 
phase? 

14. Did seatwork directions take 
longer than one minute? 

15. Did the teacher make homework 
assignments? 



X 

91% 

51% 

79% 
69% 

7% 
45% 

33% 

45% 

80% 
71% 

f 

68% 

59% 

18% 
66% 



62% 
37% 

20% 
6% 

25% 

4% 

51% 

20% 

46% 

56% 
43% 

47% 

31% 

23% 
13% 



.0097 
.16 

.0001 
.001 

.69 

.52 

.52 

.20 

.87 

.004 
.0031 

.02 

.01 

.43 
.001 



.37 
.10 

.54 
.48 

.20 
-.0? 
-.08 

.12 

.15 

.27 
.32 

.28 

.35 

-.02 
.49 



.04 
.57 



.65 
.50 

.41 

.13 
.07 

.11 

.05 

.92 

.c- 
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Table 3 

Pre Project and Post Project Means and Standard Deviations for Experimental and Control Classes 

on the SRA Mathematics Achit-^ment Test. Field Experiuent I 



Fx perlrr.ental. 
*1eans 

Standard Deviations 
Control. 

f'ieans 

Standard Deviations 



I. All Treatment and All Control Teachers 
Pre Project Data Post Prwct Data 



Raw 
Score 

11.94 
3.18 

12.84 
3.12 



Grade 

Equivalent Percentile 



3.34 
.51 

3.48 
.48 



26.57 
13.30 

29.80 
12.43 



Raw 
Score 

19.95 
4.66 

17.74 
4.76 



Grade 

Equivalent Percentile 



4.55 
.67 

4.22 
.68 



57.53 
18.07 

48.81 
17.45 



II. Control Whole Class Teachers and Control Group Teachers 
Pre Proioct Data Post Proioct Data 





Raw 




Score 


Whole Class Control. 




Means 


11.70 


Standard Deviations 


2.58 


Group Control 




Means 


14.78 


Standard Deviations 


3.14 



Grade 

Equivalent Percentile 



3.30 
.40 

3.77 
.48 



25.30 
10.15 

37.50 
12.68 



Raw 
Score 

16.20 
4.96 

20.38 
3.12 



Grade 

Equivalent Percentile 



3,98 
.68 

4.64 
.47 



43.00 
18.09 

58.77 
11.56 



tote. SRA » Science Research Associates 



ERIC 



Pre-Post Gain 

Raw Grade 
Score Equivalent Percenti 



8.01 



4.90 



4.50 



5.60 



1.21 



.74 



31.01 



19.01 



Pre-Post Gain 

Raw Grade 
Score Equivalent Percenti 



.68 



.87 



17.70 



21.27 



00 
o 



81 



Table 4 

Means and Standard Deviations on Pre and Post SRA 
and Post Prjoblem Solving Test by Instructional 
Group and by Classroom Organization, Field Experiment II 





Pre 


SRA 


Post SRA 


Pre-Post 


Post 












Change on 


Problem 












SRA 








X 




X 


SD 




X 


SD 


Control 


25.80 


4.1 




"3 7 
0 . / 


2.85 


14.71 


1 .5 


Semi 


27.35 


4.1 


30.56 


4.0 


3.21 


14.86 


1 .8 


Open 


25.36 


2.7 


27.70 


2.6 


2.34 


14.55 


.85 


Special 


27.26 


5.9 


29.78 


4.3 


2.52 


14.56 


2.1 


Treatment 


25.03 


5.0 


28.96 


4.8 


3.93 


14.90 


2.0 


Semi 


25.22 


4.2 


28.71 


4.8 


3.49 . 


15.17 


,1.4 


Open 


20.41 


1.3 


26.01 


4.9 


5.60 


13.13 


3.6 


Special 


27.44 


6.3 


31.18 


4.7 


3.74 


15.46 


1.8 
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Table 5 

Analysis of Variance Results on Adjusted Mean* Problem Solving Test Scores 
Analysis OT_v ^^^^^^ ^ Covariate) Between ^Treatment and 

Control Classrooms With Open Classes Dropped, Field Experiment II 



Source 



Treatment Condition 



DF 



MS 



5.45 



6.77 



Probabil ity 



.015 



Error 



25 



.81 



* Note the adjusted mean for the control group was -.45 and for the treatment 
group -45. 



ERLC 



Table 6 

Teacher Sample: Junior High Mathematics Study 

Partnership Teachers ' 

# Teachers 

# Regular eiqhth-grade m^»^h JUL 

# Eighth-grade algebra _L- 

# Ninth-grade algebra _jL 

Treatment Group 

# Teachers — 5_ 

# Regular eighth-grade math JL. 

# Eiqhth-grade algebra _J[L 

# Ninth-grade algebra -2_ 

Control Group - Observation 

# Teachers 

# Regular eighth-grade math J?^ 

# Eighth-grade algebra -A^ 

# Ninth-grade algebra _-L. 

Control Group - No Observation 

# Teachers — 1- 

# Regular eighth-grade math 

# Eighth-grade algebra 

# Ninth-grade alqebra 

Combined Partner and Treatment 

# Teachers -^-i- 

# Regular eighth-grade math JiL 

# Eighth-grade algebra _-L 
^ Ninth-grade algebra 

Co mblned Control - Observation and No Observation 

# Teachers ^ 

# Regular eighth-grade math 

# Eighth-grade algebra 

# Ninth-grade algebra — L 



Teacher 
Number 



Table 7 

Selected Implementation Scores by Junior High Teachers 



/ 



Treatment 
or 



Average Number 
of Minutes on 



Average Number of 
Minutes on Verbal 



Average Number Average \urr.ber of 
of Minutes or Minutes on Practice 



Development 
Overall Quality 



Average 
Imp lementat lur. 





: ontrol 


Mental Tomp. 


Problem Solving 


Development 


Seatwork 








Score 


1 


T 


2.00 


8.86 


3 .43 


5 . 


9 


j\j 




9 


^ 7 




T 


7. n 


8, 53 


8 . 20 


Q 1~ 

^ m Z ■ 


J . 








9A 
. ZU 


3 


1 


O.CjO 


0 . 7 


0,0/ 




z ■ 






1 
1 


9A 
. ZU 




1 


3.73 


6 . ' 


1 . oO 


Q 7r 


J . 


o z 




n 
J 






T 




2.73 


13.25 




T 






-) 


9 ft 
. JO 




T 


< ) . ^.iO 


2.79 


4 . 43 


1 "1 Ah 


9 


7 S 




9 


9 1 
• Z 1 




T 


1.13 


4. 53 


14.53 


1 A TP 


T 
J 


7 '\ 

Z J 




9 
Z 


9 9 




T 


1.23 


1.75 


1 o . 1 V 


1 1 /^(^ 

ii.il 


J 


O J 




9 
Z 




-J 


T 


2.(H) 


2 . a7 


6 . 40 




T 


D ) 




9 


. U / 




r 


0.{)(J 


4.07 


1 1 . 80 


11 1 
1 1 « ) J 


9 






1 
1 


ft Q 




T 


2 . 0( ' 


3 .OC' 


11.21 


1 ~ 1 


1 
J 


1 7 




1 


Q 9 






0.5 7 


3.21 


1 4 . 00 


1 1 '1 1- 

11.3*^ 


5 


/, 

■ ^H- 




1 


.93 






n .(K^ 


4. 57 


9.71 


16. 1-- 


4 


. 57 




1 


.86 




r 


0.00 


O.Oi 


5.29 


22 . 5C 


' 2 


44 




1 


.21 




n 






1 3 . 80 


K . 5 ? 


2 


. 50 




1 


.80 




c 




0 . 00 


1 7 . 00 


1,1 ,00 


2 


. 57 




2 


.33 






i ^ . Oi ^ 


0.0'" 


6, 75 


26.81 


2 


.13 




1 


.06 






( i . 0( > 


1 


1.71 


' P. ' 1 


3 


.33 




1 


.43 






0 . 1 


0.7 7 


1 3 . 46 




3 


. 73 




2 


.77 



:ei^.:.ers * ire t^artnersnip teachers; 7-il are treatment teachers; 12-16 ctre reuuKir cc'tPol teachers; 17-19 are control ^ 
teacher':, ^do d not dttend the orientation meeting. 
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lable 8 

The Correlation and p-values of Average Impleinentation , 
Time on Mentai Computation, ^and Time on Verbal Problem Solving 
with Residual Gains m Computation, Problem Solving, and Attitudes Toward Mathematics 



Average 
Inip lementat ion 



Average Instruct ion a 1 
Minutes Spent on Mental 
' Computations 



Average Instructional 
Minutes Spent on Verbal 
Problem Solving 



Computat loral Residual ( N 1 
Proh le^^.-^o I vmg Residual (N 19) 
Attitude Residual (N 16) 
Average Irp lementat i on 
Time or. ^ental Computation 
Trrne on Problem Solving 



.lb INS) 
,2t (NS) 
. 56 ( .02 ) 

.63 ( .003 ) 
. 38 ( .008 ) 



.24 (NSj 

.49 ( .05) 

.34 (NS) 

.63 (.003) 

.63 ( .003) 



.45 (.05) 

.51 (.02) 

.43 (.09) 

.58 ( .008) 

.63 ( .003) 



i I 



Table 9 

Pre, Raw, and Adjusted Means for Junior High Treatment and Control Classes 
On Pre-Math Test and on Post-SRA Subtest Scores 



Post X 

N Pre-achie v ement Computation 
Treatment 21 47.65 29.75 

Control 18 48.37 28.97 



Adjusted Post x Adjusted x 

C omput ati on ProblgnL So lving Prob lem Solvi ng_ 

29.84 21.90 21.98 

28.86 20.99 20.83 



DC 
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1. Introduction 



We believe it is possible to improve student performance in 
mathematics in important ways* We look forward to your help and co- 
operation in implementing the program that we have discussed at the 
workshop and which is outlined again in the material that follows. 
Through your efforts we believe a significant difference in student 
performance will be made. 

We do not believe that any single teacher behavior will make a 
critical difference in student learning, but we do feel that several 
behaviors in combination can make a major impact. In the material that 
follows, we present a system of instruction that, if followed daily, 
will enhance student learning. 

In general, we feel that the plan should be followed each day. 
HoWa^er, we also realize that special circumstances will force you to 
modify the plan on occasion. Still, it is important that you follow 
the daily plan as frequently as you can. 

For purposes of clarity, we will discuss each part of the 
teaching program separately. However, once again we want to emphasize 
that the program works when all parts are present. To maximize 
your opportunity for obtaining a clear picture of the instructional 
program, the program is summarized in Table 1. The rationale for 
each part and how the pieces fit together will be discussed at a 
later point in the handbook. 



Table 1 ^ 
Sunmary of Key Instructional Behaviors 

Daily Review (First 8 minutes except Mondays) 
■ ~~~~ 

a) review the concepts and skills associated with the homework 

b) collect and deal with homework assignments 

c) ask several mental coinputation exercises 

Development (About 20 minu^s) 

a) briefly fofus on prerequisite skills and concepts 

b) focus on meaning and oromoting student understanding by 
using 1 i vely exo lanai^ ons , de^nstrations , process 
explanations, i llasirations , etc. 

c) asses,$ stijdent comprehension 

1) using process/procuct questions (active irtteraction) 

2) using control IW o^actice 

d) repeat and elaborate on the meaning portion as necessary 

Seatwork ^bout 15 minutes) * . 

a) provide uninterrupted successful practice 

'b) momentum - keep the ball rolling - get ever)^ne involved, 
then sustain involvement 

c) a'lerting'- let students know their work will be checked at 
end of period 

d) accountability - check the students* work 

Homework Assignment 

a) assign on a regular basis at the end of each math class 
. except Fridays 

b) should involve about 15 minutes of work to be done at home 
C) shouWincli2de one or two review problems 

Special Reviews 

a) Weekly Review/Maintenance • 

1) conduct during the fi^^st 20 minutes each Monday 

2") focus on skills and concepts covered during the previous 
week 

b) Monthly Review/Maintenance 

1) conduct every fourth Monday 

2) focus on skills and corce^ts covered since the last 
monthly review 

* Definitions of all terms and detailed descriptions of teaching 
requests will fol low* 
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IL Development 

Variable Description 

The developmental portion of the mathematics perio^ is that part 
of the lesson d&voted to establishing comprehension of skills and concepts. 
It should be viewed ^ a continuum whKh runs from developing understanding 
to allowing for meaningful practice in a controlled setting. During all 
stages of the developmental portion of the lesson, both ends of the con- 
tinuum may be present to some degree. However, in general, the comprehen- 
sion emphasis with very little practice will come at the initial part of 
the lesson, then toward the middle of the lesson, practice with process 
feedback from the teacher will become quite prominent, and finally in the 
latter portion of the lesson there will be controlled practice with meaning- 
ful explanations given as necessary. 

The role of the teacher in the first part of the lesson, the 
comprehension phase, is to use instructional strategies that help students 
understand clearly the material being studied that day. In this portion 
of the lesson emphasis if placed upon comprehension rather than rote memori- 
zation. Activities which often focus orf comprehension include teacher explana- 
tions and demonstrations, and they may include use of manipulative materials 
to demonstrate processes and ideas, use of concrete examples in order to 
abstract common features, making comparisons and searching for patterns, 
and class discussions. ' 

During the middle portion of tne lesson, the number of questions 
posed to students may increase as the teacher begins to assess comprehension 
and provides them an opportunity to model processes already demonstrated 
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and to verbalize the iinderstanding they have developed. During this phase 
V the lesson, the teacher may decide that further explanations and i^emon- 
strations are neces.sary or decide that controlled practice is appropriate 
since students seapi' to understand what they are doing. ^ 

In the controlled practice phase of the lesson the emphasis is on 
increasing proficiency; that is, increasing speed and accuracy. However, 
meaningful feedback is still given as necessary or requested. 
Problem 

Many problems arfse in math classes in which teachers give too 
little attention to development. Students exposed to such teaching fre- 
quently attempt to memorize rules <'or doing things and concentrate on 
mechanical skills. These rules have no meaning for the student (because 
develoomental work was not done) and, thus, they are easily forgotten 
especially when new sets of rules are Uearned." When students do not 
understand what they are doing, each new problem causes them great dif- 
ficulty. Often the comment, "We haven't done any of these before" is 
heard. When students learn without understanding, the ability to transfer 
skills to new situations is greatly reduced. Other negative results such 
as the inability to detect absurd answers and loss of self-confidence alsg^ 
occur. Thus, there are many compelling reasons to include a large measure 
of developmental work .in mathematics lessons. 

Teaching Practicq^ r 

IS r 

. Initially, the teacher should focus briefly upon prerequisite 

skills that students may need for the lesson. Then the major aspect of 
the meaning portion of the development lesson occurs: active demonstra- 
tion of the concept, idea and/or skill that is being focused upon in the 

\ t \ ^ 
* ^ i 
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lesson, etc. Teachers need to demonstrate actively the process, so 
that students can comprehend the learning goal. You need to be cautious 
about moving too ouickly into the assignment of problems and practice 
without providing students wit^r an adequate conceptual orientation. 

After the active demonstration and explanation by the teacher 
(and we recommend that 10 minutes minimum be spent on this), the 
teacher should begin to assess student comprehens i :n , . There are two 
primary ways to do this. First , teachers may ask oral questions. In 
general, we recommend that teachers generally ask brief product 
oriented questions. Product questions are questions that assess 
whether or not the student can produce the correct answer (see 
appendix A for a complete description). Teachers can maintain an 
emphasis upon meaning by frequently providing process explanations 
themselves after students respond ("Yes, Tina, that's right because 
• • • / • 

The second way that teachers can assess student comprehension 
is by having students work practice problems. However, it is important 
to recognize that the le of a practice problem in this stage of the 
lesson is not to build up student speed and accuracy £er se , but rather, 
the goal is to allow teachers to assess student comprehension. He^:e, 
the assignment of problems in this stage should be limited to a sinle, 
brief problem followed by teacher assessment and explanation and then 
the provision of another brief problem assignment. In general, this 
stage of the lesson can be completed in 3-5 minutes. 

Lf your questions or assigned problems reflect a moderate 
degree of student difficulty, then you should repeat the meaning 
portion of the lesson. If possible, use different examples; however. 
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if this is not possible, verbatim repetition of the in.itial portion 
of the lesson is better than to proceed to controlled practice and 
seatwork when students are confused. Such a situation guarantees that 
students will practice errors. 

If assessment of student comprehension is largely satisfactory, 
then teachers should proceed to the controlled practice portion of the 
development lesson. Now, the teacher provides opportunity for students 
to develop increased speed, accuracy, and proficiency in comoleting 
problems of a specific type. However, the oractice is still heavily 
controlled (unlike seatwork practice which will be discussed in tne 

following section). 

During controlled practice, teachers should assign only one 
or two problems at a time. Students should not be asked to work loncer 
than a minute without feedback about the correctness of their responses. 
The reason for this is that during the controlled part of the lesson 
the teacher is still trying to identify and correct any student mis- 
understanding. Too often many students are left to watch while a few 
students demonstrate a problem on the board. A great deal of practice 
time is lost this way and often the involvement of some students in the 
lesson (iromentum) is lost as they become engaged in side conversations 

and distractions. 

During controlled practice exercises, teacher accountability 
and alerting should be immediate and continuous . By alerting, we mean 
teacher behaviors that remind students that they should be doing work 
and that it will be checked. For example, if the teacher sends 3-4 
" students to the board to demonstrate the problem that students have 
juit worked at their desks, the teacher might say, "Now the rest of 
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you do these two new problems at your desk and I'll check them in a 
minute." Such teacher behavior maintains student momentum . Instead 
of watching classmates write on the board, they have their own work 
to do and they are alerted to the fact that they will be held respon- 
^ sible for the work. 

By accountabi 1 i ty (nore on this when we describe the seatwork 
portion of the lesson) we mean the actual checking of student responses. 
For example, while students out their work on tne board, the teacher 
could look at the work of students wno remain at their desks and check 
the problems that they were to have corroieted. Furthermore, the teacher 
can call on students to provide answers to oractice problems, etc. 
Through such procedures, the teacher is able to assess when students 
are prepared to move to the seatwork portion of the lesson wnere they 
have a longer block of time for uninterrupted practice . A final impor- 
tant characteristic of the controlled seatworm portion of the lesson 
1s that the practice is done in the context of meaning (e.g., the teacher 
Is frequently providing process explanations "Yes, that's right because 
. . Although the teacher is beginning to work for speed and accuracy, 

some attention is still being paid to students* understanding of the con- 
cepts, ideas, and skills that are being developed. 

In summary, the development part of the lesson calls for the 
following teacher behavior: 

(1) Review briefly and/or identify prerequisite skills. 

(2) Focus upon the development of meaning and comprehension 
using active demonstration and teacher explanation. 

(3) Assess student comprehension (ask questions/work on 
supervised practice). 
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(4) Repeat meaning portion of the lesson as necessary 
(using different examples and explanations if possible). 

(5) Provide practice opportunities for students. 

(a) Practice should be short (one or two problems at 
a time). 

(b) Students should be held responsible for assigned 
practice problems. 

(c) Practice should be performed in a meaningful context 
( teacher provides frequent process explanations ) . 

(d) When success rate is high, move students into 
seatwork portion of the lesson where students have 
an opportunity for uninterrupted practice. 
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III. Seatwork 

Variable Description 

Seatwork refers to practice work that students complete individually 
at their desks. Since seatwork practice follows the controlled practice part 
of the development lesson, students should know the purpose of assigned 
problems and how to do them when they begin to work. The role of seatv.ork 
practice is both important and easy to describe. Seatwork assignments 
allow students to practice, on their own, problems and principles that you 
have just actively taught. Seatwork provides students with an opportunity 
for immediate and successful practice. This practice experience allows 
students to achieve increased proficiency and to consolidate learning. 
New material or review work should not^ be assigned during the seatwork 
portion of the lesson. 
Problem 

Often a great deal of time is wasted when students work on problems 
individually. Indeed, research has consistently shown that students show 
less Involvement (amount of time that students actually spend working on 
problems) during the seatwork portion of the lesson than during the active 
teaching portion of the lesson. Too often teachers stop active supervision 
after they make the seatwork assignment. Two of the more common ways that 
teachers stop supervision are by doing desk work, grading or oy providing 
extended feedback to a single student (before all students are working on 
the task). Such behavior virtually guarantees that teachers cannot provide 
the type of supervision that students need if they are to begin to work 
productively. The first teaching task is to get students started on the 
seatwork. Often students do not use seatwork time productively simply » 
Q bec'use the teacher does not obtain thc-ir attention initially. 

ERIC ^ ^ ^ 
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In addition to the problem of not "demanding" students to start 

work, some teachers create a problem by moving from the development portion 

of the lesson to seatwork with such abruptness that it is not surprising 

that students do not begin to work immediately (e.g., four students spring 

to the pencil sharpener, two students search for materials, and three 

students begin a private conversation). Momentum needs to be maintained 

throughout all stages of the lesson. When nx)mentum is lost, students are 

apt to take a osychological break and once nomentum (student attention and 

involvement) is lost, it is difficult to "recapture." Teachers who end the 

development cortion of the lesson with a controlled practice segment have 

done much to ease the transition from the group lesson to individual 

seatwork. 

Teaching Request 

Given that the role of seatwork is to provide opportunity for suc- 
cessful practice, we recommend that about 10-15 minutes each day be allotted 
for seatwork. Ten to fifteen minutes allows sufficient time for students to 
work enough problems to achieve increased proficiency but not so long as to 
bring about boredom, lack of task involvement, and the behavioral problems 
that soon follow when students are bored or frustrated. Frustration should 
be minimal in seatwork activity because the problems students are asked to 
do are a direct extension of the deve; i"ient part of the lesson. If prac- 
tice time does not exceed 15 minutes, few students are likely to be bored. 

The number of problems assigned should take most students only 15 
minutes to complete. Hence, approximately 75 percent of your students should 
be able to complete the work within the allotted 15 minutes. In making the 
seatwork assignment, emphasis should be placed upon accurately working as 
many problenis as possible within the allotted time. Low achievers who remain 
on task and do accurate work have done well and should know that they have 
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done well. That is, the criterion to communicate to students is to keep 
working and to do as many problems accurately as they can. 

To help optimize the effectiveness of seatwork, three general prin- 
ciples should be observed. The first principle, momentum , has already been 
discussed indirectly. By momentum we mean keeping the ball rolling without 
any sharo break in teaching activity and in student involvement. Teachers 
can achieve mc^entum by ending the development portion of the lesson by 
working problems similar to the ones that students are asked to work 
individually and by starting students on individual work with a simple 
and direct statement, "We've worked oroblens 1 and 3. IJow, individually, 
at your desk do oroblems 5-15. V/ork as many oroblems as you can, and 
we*n check our work in 15 minutes. Remember doing the problem correctly 
is more important than speed." Following such a statement, you should 
actively monitor all students . Before providing feedback to individual 
students, make sure all students are engaged in the seatwork. 

If some students do not begin working immediately, walk to their 
desks and if your physical presence doesn't initiate student work as it 
usually will, then quietly say something like "Frank, it's time to do the 
problems." After all students are working on the problems (the ball is 
rolling), you can then attend to the needs of individual students. In 
general, students should get immediate feedback and help when it is needed. 
Thus, it is usually reasonable to a1\low students to approach you when they 
have a question or problem. However, when presenting feedback to individual 
students, keep in mind the general principle of momentum. You have to 
provide feedback and conditions that allow most students to stay on task 
(keep working). Hence, it Is not advisable to continue to provide lengthy 
feedback to an individual while several students are waiting for teacher 
feedback before they can continue to work. 
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Alerting is a second principle to observe during seatwork. 
Alerting behaviors tell students that they will be held accountable for 
their work. Often students engage in off task behavior because they are 
not alerted to the fact that they will have their work checked at a 
specific point in ti.e. If students are assigned seatwork that won't be 
checked until the following day (or when it is not checked at all), stu- 
dents are not likely to be h.gnly engaged in seatwork. A statement l^Ke. 
"We'll check the work at the end of the period." alerts students to the fact 
that there is reason to engage in productive work immediately. A statement 
at the becinn.ng of the seatwork is sufficient. Reoeatod statements are 
apt to interler with st.cents' work concentration. Public announcements 
should not occur during seatwork. Once you have students working it doesn't 

make sense to distract them. 

Accountability is the third principle to observe during seatworm. 
Alerting. « we noted, is a signal to students tnat their work will be 
checked. Accountability is the actual Checking of the work. It is impor- 
tant thil-your accountability efforts do not interrupt the seatwork behav,or 
of students. During the controlled practice part of the lesson (see develop- 
ment section), accountability is Innediate. However, during the seatwork 
portion of the lesson, students are to be work,ng more ,ndependentl, and 
those students capable of doing the work need ti.e for uninterruEted EriSil" 
P„bl1c accountability needs to b. -til the end of the lesson. A 

teacher's public questions during this stage of the lesson are very disrup- 
tive For example, when the teacher asks a public question (e.g.. "How many 
of you have done the first four problemsT." "that's the answer to the second 
problemT." etc.) all students stop work and once momentum is lost, some 
students will take much time before resuming their work. Furthermore, _ 
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Students anxious and distract them from task behavior if they have not 
worked the first four problems. Occasionally, you may need to stop seat- 
work practice to correct a common misunderstanding. In general, these 
errors should be corrected during the development (controlled practice) 
phase of the lesson. Public statements (except 'for necessary behavioral 
management) should be avoided. If most students are not ready for seat- 
work practice, then you should stay in the controlled practice part of 
the -lesson. Such behavior will help students develop the fonowing atti- 
tude toward seatwork: "I can do the problems and now it is ti.-e for ir.e 
to apply myself." 

Perhaps the most direct and easiest way to hold students puDlicly 
accountable without disrupting seatwork is to call on individual students 
at the end of the lesson. Checking students* work at the end of the period 
also provides the teacher with a chance to spot any systematic mistakes that 
students are making and to correct those misunderstandings. Hence, when 
your students are assigned their homework, conditions should be set so that 
the homework provides for additional and relatively successful practice. 

Specifically, we are asking you to get student involvement ifnnediately 
after making a seatwork assignment. Continue to monitor and supervise all 
students until they are engaged in assigned work ( the first minute or two ). 
Early in the seatwork period (the first three to five minutes), be available 
for students when they need feedback. Toward the end of the seatwork period, 
try to get to the desks of some low achievers to see if they are 'making any 
systematic errors and to provide feedback as necessary. At the very end of 
the seatwork period, hold students accountable for their work by asking indi- 
vidual students to give the answer to a few of the assigned problems. This 
checking of answers should be very rapid and you ne4i only check 3 or 4 of 
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the problems (check one or two problems at the first, in the middle and 
at the end of the assigned work). If misunderstandings are corrected here, 
the homework should be a successful practice experience for most students. 

When conducting the review of seatwork, it is generally advisable 
to call on low achievement students to provide answers only to the first 
few problems assigned so as not to frustrate them for failure to complete 
all problems, but be sure to increase seatwork expectations for these stu- 
dents as the year progresses. 

Finally, all seatwork should be collected, ^his helps encourage 
students to work productively because they knew that they are neld accountable 
for the wo-k assigned during seatwork. Because of the way teachers have 
used seatwork in the past, many students have built up the expectation that 
seatwork is a time to relax and waste time. Taking up the seatwork will 
help students t© adjust to the expectation that seatwork is a time to 
apply themselves and to see if they can do the type of problems which 
will be assigned as horework. Although there is no compelling reason to 
grade seatwork, it is important to examine the papers to see if students 
are using seatwork time appropriately. If a student's work is unduly 
incomplete, impossible to read. etc.. it would be important to mention 
this to the student so that he or she knows that you care about his seat- 
work performance. 

After the seatwork is collected, the homework assignment is made. 
Delaying the assignment of homework helps to insure that students will do 
the work at a later point in time, hence, building distributed (repeated) 
practice into the mathematics programs. Research has consistently shown 
the superiority of distributed practice over mass practice in helping 
students to master and retain new concepts and skills. 
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IV. Homework 

Variable Descriotion 

- ■ ■ ■ ■ I 1^ 

Mathematics homework is written work done by students outside 
the mathematics class period. It is usually done at home; thus, it is 
distinctly different from seat.'/ork which is done within mathematics 
class tine. 
Problen 

The eniDhasis on homework in scnools over the years has varied 
considerably, unfortunately, /.oTewcrk nas been misused frequently. 
Sometires the assignments were so long that students became bored and 
careless when working the assigned problems. No doubt some students' 
dislike for mathematics is in part associated with these leng/hy assign- 
ments. The instructional value of long homework assignments is very 
questionable. If students make errors on the first few problelris of 
the assignment, then by the end of the assignment they may have\become 
more proficient in making those errors! 

Other situations in which homework has not been used to its fjuU 
potential are plentiful. In some schools homework is never given or 
so few problems are assigned that an excellent opportunity for dis- 
tributed practice is wasted. Another undesirable situation occurs when 
homework is given primarily to please parents but without much attention 
to selecting problems and assignments that will foster progress toward 
important objectives. But_ perhaps the most devastating misuse of home - 
work is when children are assigned problems for which inadequate background 
has been developed in class. While long assignments often lead to 
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frustration, this latter situation always leacis to frustration and 
negative attitudes toward the mathematics class. 

Another situation which detracts from the value of homework . 
assignments happens when the teacher fails to stress the importance and 
value^of Che problems Assigned. This can be done directly by not 
. commenting on the importance ;of assignments or indirectly by not scoring 

0 

or collecting assignments. 

If spite of these misuses of homework, horework can be an 
important part of mathematics learning if certain guidelines are followed. 
Research suggests that giving homework to students on a reoular basis may 
increase achievement and improve attitudes toward mathematics. Short 
assignments have been found to be most effective and some variety in 
- the type of homework is helpful. Also, if a teacher gives importance 

to- the homework through oral- comments and by scoring papers regularly, 

then students frequently respond by completing their assignments with 

greater care. 

Teaching Request 

'Because of the important role that honiework can .play in improving 
student performance in mathematics, we would like to have you do the 
following during the study: 

1. At the very end of ttfe\ath class period on Monday 
through Thursday, give ^-.homework assignment which is 

due at the beginning of the class period the following day. 

2. Each assignment should require about 15 minutes of outside 
class time. Within this time frame, assignments will 
probably average about eight problems per day depending 

on the kinds of problems being assigned. A typical assign- 
\^ ment is shown in Appendix B. 

3- * The primary focus for an assignment should be on the major 
' ideas discussed in class that day. Also each assignment 
given on Tuesday and Wednesday should include one or two 
review problems from the current week's work. 
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4. Each assignment given on Thursday should be primarily devoted 
to review problems from the current week's work. In order 
for sufficient practice to be given on the material discussed 
on Thursday, this assignment will be a bit longer than assign- 
ments for other days and will probably take about 20 minutes 
for most students to complete. 

Typically, each assignment should be, scored (number correct) 
by another student. Papers should then be returned to their 
owners for brief examination. Finally, papers should be passed 
forward so that the scores can be recorded in the grade book. - 

6. The assignments given should be recorded daily in the 
Teacher's Log. 

The short horework assignments complement seatwork by distributing 
ractice over tire without putting undue time pressure on students. 
Short assignments help hold student interest; adding variety to assign- 
ments is also helpful. This can be done by embedding the problems to 
be worked in different formats such as games, puzzles, codes, and so on. 
Appendix C illustrates this idea. Another component of variety might be 
to have students check their work. Multiplication problems can be checked 
by doing division, addition problems by doing subtraction, and so on. 
Variety can also be introduced by giving differentiated assignments. 
Far example, some students could be given ten easy problems, while other 
students are given six problems of a more difficult nature. 

The scoring and recording of grades on all homework assignments 
are designed to emphasize the importance of homework and to provide 
regular feedback to students and teachers regarding progress being made by 
each student. It is important to realize that there are a number of 
efficient ways to score homework other than the teacher's going through 
the papers individually, plr instance, students can exchange papers or 
score their own papers. Either of these procedures is improved if students 
are expected to have their homework completed and ready to be scored at the 
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v»ry beginning of math time. Efficiency is also improved if answers 
are prepared in advance by the teacher in written form (transparency, 
blackboard) and then shown to the students. Otherwise, the teacher may 
need to orally repeat each answer a large number of times. 

Explanations and reteaching the homework must be somewhat 
limited if ac'equate time for discussion and practice of new material 
is to be available. Tnis should not cause too^much difficulty becaus2 
most student di^'ficulties and e-rors should have been remediated prior 
to the seatwork of .the previous day. 

A good strategy ray be to quickly have children exchange and 
. score papers, tren have children indicate by raising their hands--how 
many mi.sed problems =1. 42, and so on. Then you can rapidly work the 
one or two problems that caused students the most difficulty. Since 
there are usually only a small number of homework problems to be 
checked and discussed, this part of the lesson should be easily com- 
pleted in two minutes. Finally, note that any reteaching that is not 
completed can be done during the weekly review that is discussed in the 
next section. 

In the rare event that the checking of homework reveals numerous 
student errors, you should reteach the previous day's lesson beginning 
with development, then controlled practice, then seatwork, and finally 
a homework assignment on the same material. Under these circumstances 
you should not try to cover new material due to the very limited amount 
Of time available to develop the new ideas. 

You are requested to personally score the homework that is 
assigned on Thursdays. There are two reasons-for this. First, the 
information gathered from this homework isVto be used to structure the 
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weekly review each Monday. Second, the focus of student scoring is 
of necessity on answers rather than kinds of errors being made. It 
is very important, however, that regular attention be given to the 
procedures and processes that students are using. This is especially 
true when they are making errorsl 

In connection with the sconng^of Thursday's work, each i^tident's 
paper should be analyzed for systematic error patterns. Systematic 
error patterns refer to incorrect procedures which are consistently 
used on a wide range of problems. In two-digit multiplication prcblc^s, 
for example, a student mignt consistently forget to "carry" the tens 
digit from the initial multiplication of the units digits. According to 
recent, research such errors are much more common than was once realized 
and, thus, spending time examining homework with them in mind can be very 
helpful in remediating some students' difficulties with mathematics. 
Further examples of common computational error patterns can be found 
in Appendix D. Since the particular errors you fiad probably will not 
be associated with groups of students, the remediation of such errors 
is usually best done on a one-to-one basis. 

Homework is an important component of this program and since both 
students and teachers devote a considerable amount of time to it, it is 
recommehded that homework count at least 25 percent of each student's 
math grade and that this information be communicated to them. 

Parents are interested and should be informed about what is 
happening in school. Therefore, it is recommended that an explanation 
of the homework policy to be followed during the study be sent home to 
parents. A letter which could be duplicated and used for this purpose 
can be found in Appendix E. 
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Homework is explicitly related to each of the other components 
of the study in a number of ways. With an increase m development fme. 
it provides an opportunity to supplen^nt the practice part of the lesson. 
It is structured such that practice .s distributed over time and students 
have an opportunity to correct difficulties encountered in seatwork. 
The homework provides important information for structuring the soecific 
details to be covered in the review component. It is also related to 
the pacing variable in that it allows some necessary work to be done 
outside of the tire regularly scheduled for math. • 
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V. Special Review/Maintenance* 

Variable Description 

Children forget. It is imperative, therefore, that ideas be 
reviewed and skills maintained on a systematic basis in elementary school 
mathematics. Reviewing ideas may involve the teacher stating and explaining 
properties, definitions, and generalizations and the students recalling the 
appropriate ter^i or na.ne. These roles occasionally may be reversed (where 
the teacher supolies a tern and the students illustrate and explain), but 
the focus should generally be devel ooriental in nature. That is, there 
should be a strong emphasis on meaning and corriprehension. Similarly, skills 
need to be practiced with regularity in order that a high level of proficiencv 
be maintained . The focus should be developmental in nature; comprehension 
again is an important component. 
Problem 

When discussing children's performance in mathematics, frequently the 
comment is made that many have not mastered the basic skills. From this it 
is concluded that teachers do not spend enough time teaching basic computa- 
tion. But this conclusion often is not valid because the inability to per- 
fonn may not_ be associated with the initial learning but rather with a lack 
of maintenance. Newly learned material is particularly susceptible to being 
forgotten, but even material thought to be "mastered" is sometimes lost. 
For example, many fourth grade teachers have had the experience in which 
a student seems to have mastered his basic multiplication facts, indeed, 
he or she can reca;: them with almost 100 percent accuracy but four weeks 
later seems to have forgotten a great number of them. 

♦The review discussed here is in addition to the brief (1-4 minute) 
daily review that we will discuss later in the handbook. 
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Teaching Request 

To minimize this problem and similar problems, we are asking that 
you incorporate review/maintenance sessions regularly into your mathematics 
instruction. Regularly in the sense that each Monday you have a Weekly 
Review/maintenance session and every fourth Monday you have ^ Cumulative 
Review/maintenance session. The Purpose of the two types of review sessions 
is to help students retain concepts and insights. 

Uppjcjy Rpview/n-aintenance . The following things are necessary to 

do if the review/maintenance component is to be imolemented effectively: 

1 The first one-half of each Monday's path oeriod (rouanly 25 mnutes) 
should be devoted to review/maintenance. 

skills and ideas are: 

a. Those that are thought to be mastered and can be done very quickly. 

b Those that need additional development and oractice as identified 
from the analysis of the Thursday homework assignment. 

c. Those that need additional work (as identified during this rev.iew 
session). 

Most of the important skills and concepts that should be reviewed 
can easily be identified by examining the homework assignments from the pre- 
vious week. That is, these homework assignments deal .ith each important 
data or skill; thus, reviewing them will assist you in identifying important 
topics. It is of utmost importance that all major ideas covered during the 
week be reviewed. Reviewing ideas that students have "mastered" the pre- 
vious week helps to guarantee that ideas will be retained. Areas in which 
some reteaching is definitely needed should be identified in advance by the 
teacher from an analysis of the Thursday homework assignment and handled 
during the second portion of this designated review segment. 
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There are many ways that this maintenance program can be successfully 
organized. One important attribute of any effective organizational scheme 
is active student involvement. In nx)st teaching situations, it is important 
to avoid situations that involve only one student in checking problems because 
such a procedure is usually ineffective and boring to most children. This 
is especially true in a review situation in which students are already familiar 
with the problem. One scheme that we highly recommend (because it overcomes 
this difficulty) is one in which the teacher presents an idea or problem and 
then allows students to work individually at their desks until most arrive 
at an answer. Finally, answers are checked (children are held accountable), 
and soneone explains or demonstrates how to arrive at the answer (in many 
cases by using the chalkboard at the front of the room). 

Cunulative Review/maintenance . This aspect of the review/maintenance 
program can best be implemented in the following way: 

1. Every fourth Monday the entire math oeriod should be devoted to a 
cumulative review/maintenance session. 

2. This review should encompass the work of the previous four weeks and 
thus replace the regular Monday maintenance/review session. 

This session provides an opportunity to reteach ideas that have given 
difficulty over the past four weeks. It will be particularly useful to those 
students who have difficulty acquiring skills and ideas on initial exposure. 

The interest in and value of this review session can be greatly 
enhanced by structuring it in an interesting format such as a game, contest, 
or quiz show. 
Postscript 

On occasion, it may be desirable to reschedule a review for a day 
other than Mon^^^y. For example, if by not reviewing on a Monday you can 
complete a chapter or unit, by all means do this and simply conduct your 
review on Tuesday. If it becomes necessary for you to reschedule a review, 
please make a note of it in the log so that.we^^re aware of it. 
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VI . Mental Computation 

Variable 

Mental computation is computation that i,s done without the aid 
of pencil and paper (or minicalculator) . The process is done by the 
most powerful computer of all. the Human brain. Mental processing is 
Often vastly different than pencil and paper calculation. For example. 
In pencil and paper addition situations the calculation always goes 
from right to left . The student asked to solve 41 + l2 on paper is 
going to move mechanically from right to left. However, in a mental 
activity (the teacher says what is 41 + 12) the student may frequently 
move from left to right . First, the student does something to the tens 
column, then to the ones column, and then combines. We feel that the 
inclusion of some time for mental computation each day will help students 
to further develop their quantitative sense, to become more flexible in 
thinking and in approaching problem-solving situations. Furthermore such 
activities help students to detect absurd answers (e.g. when checking their 
written computation) and make estimations that are frequently needed in 
daily activities. 
Problem 

The attention given to mental computation and mental problem- 
solving has largely disappeared from the modern mathematics curriculum. 
At one point in time much emphasis was given to mental problem solving. 
This de-emphasis has occurred despite some research evidence which suggests 
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that mental practice on a regular basis appears to be related to large 
increases in student achievement. If students are not given some work 
in mental computation, then they are missing a very important way to check 
their work (other than the time consuming and Inefficient process of com- 
pletely redoing the work). 
Teaching Request 

We would like for you to include 3-5 minutes on mental computa- 
tion activities each day at the beginning of the lesson; the predevelop- 
ment part of the lesson will be described later in the handbook. Ideally, 
the raterial presented for mental resolution would be related to the con- 
tent of the material being studied. During the study of subtracriqn, 
mental computation activities should focus on subtraction. However, 
some units that you study in the year will not lend themselves to this 
form of mental processing. During such a unit (e,g, geometry) it would 
be useful to rotate on a daily basis with the following types of mental 
computation activities: addition, subtraction, multiplication, division, 
and verbal problems. 

The following examples will give you some ideas about the kinds of 
problems you may present to your students. Some of the examples here may 
be too easy or too difficult for your students. You should try to use 
problems which are challenging yet accessible to most students. It is a 
good idea to discuss how a problem might be solved mentally before students 
are asked to give solutions. 

For example, for a problem like 6 x 12 you might suggest thinking 
as follows: "6 times 12, that's 6 times 10 plus 6x2, that's 60 + 12, 72," 
Then begin giving students problems one at a time to solve like 8 x 12, 6 x 
15, and so on. It is worthwhile to mention to the students that there are 
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manir wajii to sojve problems mentally and the way you showed is but one way. 
Children should be encouraged to discuss them mental computation procedures . 

Further illustrations of the kinds of problems which are appropriate 
are given below. You should generate other types of mental computation 
exercises for your students as well. 
Addition 

(1) 75 + 77 = 



Think: 77 = 70 ^ 7. First add 70 to 75 (145) then add 7 to 
that sum (152). 

or- Rename 77 as 70 W ana 75 as 70 - 5. Add the tens (140). 
add the ones (12), tnen f^rd tne total of the sums (152). 



(2) 97+8 



Think- How much do I adc to 97 to get 100? The answer is 3. 
Think. f^J^l^^ 3 , I add 3 to 97. and then add 5 



to the sum. 



(3) 243 + 104 = 



Think: 104 = 100 + 4. First add 100 to 243 and then add 4 to 
the sum. 



(4) 125 + 49 



Think: 49 is 1 less than 50. Since 125 + 50 = 175. 125 + 49 - 174. 



Subtraction 

(1) 125 - 61 



Think: 61=60+1. Fi rst subtract 60 from 125. and then subtract 
1 from the difference. 

(2) 105 - 8 = 



Think: First subtract enough from 1C5 to get 100: 105 - 5 = 100 
Since 8=5+3. subtract 3 more: ICO - J - ^z- 



(3) 425 - 97 = 



Tu^ u. 07 - inn - 3 First subtract 100 from 425, and then add 
'''''' 3 t'o Z difference! 425 subtract 100 is 325. add 3 is 328. 
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Multiplication 

(1) 20 X 36 = 

Think: 20 = 2 x 10. Ten times 36 is 360, and 2 x 360 = 720. 
or: 2 X 36 = 72, so 20 x 36 = 720 , * 

or: 20 x 36 that's the same as {h x 20) x (2 x 36), or 10 x 
72 = 720. 

(2) 4 X 17 x 25 = 



Think: Since the product of 4 and 25 is 00, these numbers are 
multiplied first. Then 100 is multiplied times 17, 

(3) 32 X 50 = 



Think: The product is uncnanqed if I double one factor and half 
the other factor. Thus, 32 x 50 is the same as 64 x 25 
or 1,600. 

^(4) 4 X 53 = 



Think: 53 = 50 + 3. Four times 50 is 200. Four times 3 is 12. 
So to find 4 X 53 add 200 + 12. 



Division 



(1) 84 f 4 = 



Think 84 = 80 + 4. 80 divided by 4 is 20 and 4 r 4 is 1 , so 
84 i 4 is 20 + 1 or 21. 

(2) 396 ^ 4 = ' 



Think: 396 = 400 - 4. Since 400 t 4 = 100 and 4 f 4 is 1, the 
quotient is 100 - 1 or 99. 

(3) 250 V 50 = 



Think: 250 i 50 is the same as 500 i 100 which is 5. 
Verbal Problems 

(1) Mr. Thomas has a debt of $120. If he pays $70 of it, how large 
a debt will he have left? 

Think: I need to find 120 - 70 = 



12 - 7 = 5, so 120 - 70 = 50. 
50 is the answer. 
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VII. Instructional Pace 



Variable Description 

Instructional pace refers to rate. It may be thought of in terms of 
how quickly a class is roved through a given curriculum or in terms of how 
rapidly students are presented with particular topics. The pace associated 
with different teachers varies. Some teachers move through the curriculum 
faster than others. 
Problem 

Instructional paoe may inhibit learning in several ways. At one 
extreme is the situation in which a teacher moves through the curriculum 
too quickly for learning to take place. At the o'ther extreme is the teacher 
who plods along so slowly that many of the students are bored. Furthermore, 
some teachers, because of their slow pace, find themselves forced to cover 
so much material at the end of the year that they do not have time to build 
in the distributed practice which is essential if students are to retain the 
n,aterial. Research ^suggests that for most teachers efficiency could be 
improved if they increased their pace slightly. That is. there seems to be 
n^ore of a tendency to procrastinate than to move fon^ard. If the suggestions 
presented earlier in the manual are implemented in your teaching program, 
the important element of review and distributed practice should be fulfilled 
and you will probably be able to pick up the pace. 
Teaching Request 

For this variable we ask that you carefully consider your teaching 
behavior with respect to the instructional pa.e you s.y Many of you will 
find that you can increase the pace so^^what and we ask you to attempt to do so, 

The instructional strategies suggested in this study are such that 
if you speed up a bit too much, then you can resolve problems that arise^- 
through your regularly scheduled review/maintenance sessions. 
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VIII. Starting / and Ending the Lesson 

We have now discussed the major parts of the mathematics instruc- 
tional program. Two aspects that we have not discussed explicitly are 
the start and end of the lesson. 

The beginning portion of the lesson ( Predevelopment ) wiH have three 
parts: (1) a brief review, -(2) the checking of homework, and (3) some 
mental computation exercises. ..e ask that all three of these activities 
be done^i-thin tne first eight minutes of the class period This may be 
difficult for teachers who slo./ly ease into the lesson, but it has been 
commonly observed that time is frequently used inefficiently at the 
beginning of a lesson. 

The review of the previous day's lesson should begin with a brief 
summary by the teacher. Several sentences that briefly and concisely remind 
students of what they did and why, and demonstrating how to solve a single 
problem is usually sufficient. Next comes the checking of homework. This 
should proceed very quickly once students learn that when math period 
begins they are to have their homework on top of their desks ready for 
checking. Initially, it may take some time to establish this routine, 
but once the routine is established it should take only a couple of minutes 
to check homework. 

The third activity, mental computation, plays two roles in the' 
lesson structure. First, it is an important activity £er se (see earlier 
section). Second, these activities can provide a smooth" transition for 
getting students engaged in thinking about math prior to the point at 
which the teacher begins a new development ^esson. 

ERIC IJJ * 
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' The endin g of the lesson is a very simple procedure. After allowing 

students a period of time for uninterrupted practice, the teacher briefly 
checks pupils' work on a few problems (may call on students, ask students 
who got problems correct to rais«> their hands, etc.). This accountability 
■procedure encourages students to apply themselves during seatwork and 
allows an additional opportunity to clear up misunderstanding. After 
checking some of the seatwork. the teacher ends the nathematics lesson 
by assigning the homework p-oblems. 

The predevelopment phase of the lesson should t^ke roughly eight 
minutes. The exact distribution of time on review, hor.ework , and mental 

computations depends upon a variety of conditions (e.g. moderate difficulty 
with homework vs. no difficulty) and you are asked to use your judgmenj^^ 

In general, we think the following situation will be most applicabl^: 

1-2 minutes on review; 3-4 minutes checking homework; and 3-4 minutes on 

mental computations. 
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IX, Summary and Integration 

We have asked you to do several things during the next few weeks 
in an attempt to improve student performance in mathematics. In the first 
part of this handbook we emphasized that we didn't feel that changing one 
or two teacher behaviors would make much difference in student performance. 
We feel that the systematic application of all the behaviors discussed in 
this treatment prcgra'i can make an important difference in student learning, 
^he purpose of this last section is tn briefly review the teaching requests 
we have made and to snow how each of the pieces fit together into a total 
program. 

The predevelopment portion of the lesson begins with a brief 
summary and a raview of the previous^ lesson. The review (including the 
checking of homework) is designed to help students maintain conceptual and 
I skill proficiency with material that has already been presented to them. 
/ Mental computation activities follow and provide an interesting bridge for 
moving into the new lesson, 

^ Next comes the development part of the lesson which is designed 
to help students understand the new material. Active teaching helps the 
student comprehend what he Is learning. Too often students work on problems 
without a clear understanding of what they are doing and the reasons for 
doing It. Under such conditions, learning for most students will be filled 
with errors, frustration, and poor retention. If student learning is to be 
optimal, students must have a clear picture of what they are learning; the 
development phase of the lesson is designed to accomplish this understanding. 

The controlled practice that occurs toward the end of the develop- 
ment portion of the lesson Is designed to see if students are ready to begin 
Q seatwork. It simply doesn't make sense to assign seatwork to students when 
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they are not ready for 1t. . .practicing errors and a frustrating expedi- 
ence guarantees that student Interest and performance In mathematics will 
decline. The controlled practice part of the lesson provides a decision 
point for the teacher. If students generally understand the process and 
are able to work problems corjectly, then the teacher can proceed to the 
seatwork portion of the lesson. If student performance on problems Is rela- 
tively poor, then the development must be retaugfit . If students are ready 
to do practice work, it is foolish to delay them; similarly, if students are- 
not ready to do development work, it is fooMsh to push them Into it. The con 
trolled practice part of the lessons allows the teacher to decide if it is 
more profitable to move to seatwork or to reteach the development portion of 
the lesson. 

Hence, when teachers move to the seatwork portion of the lesson, 
Students should be ready to work on their own and practice should be rela- 
tively error free. Seatwork provides an opportunity for students to prac- 
tice successfully the ideas and concepts presented to them during the develop- 
ment portion of the lesson. If teachers consistently preseqt an active 
development lesson and carefully monitor student performance during the 
controlled portion of the lesson, then student seatwork will be a profitable 
exercise In successful practice . * 

The seatwork part of the lesson allows students to organize their own 
understanding of concepts (depend less upon the teacher) and to practice 
skills without interruption. The seatwork part of the lesson also allows the 
teacher to deal with those students who Have some difficulty and to correct 
their problems before they attempt to do homework . If teachers actively 
monitor student behavior when seatwork Is assigned and if they quickly engage 
them in task behavior and maintain that Involvement with appropriate 
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accountability and alerting techniques, then the essential conditions have 
been created for successful practice. 

Homework is a logical extension of the sequence we have discussec. 
During the mathematics lesson students learn in a meaningful setting. 
During seatwork students have a chance to practice and deal with material 
they understand. The homework assignment provides additional practice 
opportunity to further skill development and understanding. 

The above asnects of the nathematics lesson combine to give the 
student: (1) a clear understanding of what they are learning; (2) con- 
trolled practice and reteaching as necessary to reinforce the original 
concents and skills; (3) seatwork practice to increase accuracy and speed; 
and (4) homework assignment^ which allow successful prac . on mastered 
material (distributed practice which is essential to retention). 

To maintain skills it is important to build in some review. Skills 
not practiced and conceptual insights not reviewed from time to time tend 
to disappear. Even mature adults forget material and forget it rapidly. 
For this reason we have asked you to provide for review of material pre- 
sented the previous week each Monday and to provide a comprehensive review 
every fourth Monday . Such procedures will help students to consolidate 
and retain their learning. Finally, we have suggested that the systematic 
presentation of mathematics material may facilitate student learning (i.e., - 
initial acquisition) such that you can pick up the pace a bit and we encour- 
age you to do so if you can. Finally, when many students experience trouble, 
the development portion of the lesson should be repeated and students should 
never be asked to do homework until tney are ready to do it successfully. 

The plan described above is summarized in Table 2 that follows. This 
table outlines the sequence and length of each lesson component in order to 
provide a general picture of the mathematics lesson that we are asking you 
ERiC to teach. 
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Appendix A 
Process/Product Questions 

Variable Descrintion • 

Process questions ask the student to explain something in a 
way that requires him or her to integrate facts or to show knowledge 
of interrelationships. Process questions often begin with wh^ or how 
and can't be answered with one word. Many process questions require 
the student to specify the cognitive and/or behavioral steps that must 
be gone through in order tc solve a problem or come up with an answer. 
Two examples of process questions follow. "Allen, if a man bought 3 
tickets ^or $2.85 and 2 tickets for $2.15 and if we wanted to know the 
average cost per ticket, how could we get the answer?" Similarly, if the 
teacher asks "There are 60 minutes in an hour, how can we find out how 
many minutes in h hour?", she or he is asking a process question. The 
student is asked to explain a process and to verbalize understanding 
("we can always find h of anything by dividing by 4 . . ."). 

Product questions only require a knowledge of a specific fact 
and can often be answered with a single word or by prov.ding a number 
(answer to a problem). Product questions often begin with the words 
who, what, when, where, how much, how many, etc. A written example of 

a product question would be 7 + 3 = -> An oral product question would 

be "zero times seven equals how much?" 

Product questions can be transformed into process questions by 
asking for an explanation rather than an answer. "Why does zero times 
seven equal zero?" The child is being asked to show awareness of the 
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principle by saying something like "when zero is a factor the product 
is zero" or "zero times anything equals zero." A written example of 
a process question would be "7 + 3 = 10 and 3 + 7 = 10, why?" The 
student is expected to respond with something like "changing the posi- 
tion (order) of the addends (numbers) does not change the sum." 

In suirmary, product questions are those questions that ask 
students to provide the right answer (how much, what, when). In 
contrast, process Questions ask students to explain how an answer 
was or could be cDtained (why questions). 
Problem 

Often when teachers think about development and conceptual 
work, they equate it with process questions. This is not the case. 
Indeed, often process questions are overused or used inappropriately. 
The problem with process questions is that they are sometimes ambiguous 
to the student (what is the teacher asking me?) and may produce an 
ambiguous student response even though the student understands the 
concept. Process questions often consume a lot of instructional 
time (student thinks, mentally practices the response, makes an oral 
response). Hence, if process questions are overused, a lot of instruc 
tional time can be wasted. If selectively used, process questions can 
be very valuable. For example, by asking a few process questions, 
teachers can see if students understand the rationale or principle 
upon which computational work is based and help consolidate student 
learning. 

If teachers are alert to student responses, hold students 
accountable by asking individual students questions, and keep all 
students involved in the lesson, then the learning of unproductive 
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habits is minimized. If process and product questions are used 
appropriately, then student involvement and achievement are enhanced. 
If they are used inappropriately, then much instructional time is lost 
and errors are practi ced— errors that <:ubsequently are very hard to 
correct. 

Request for Teaching Behavior 

We feel that the presence of a few process questions in the 
development stage of a lesson are helpful (especially when a new 
principle is being introduced) because listening to a student's 
explanation can help teachers diagnose inappropriate assuTptions, etc., 
that students have made. However, we believe that most of the process 
development can be done through teacher modeling of grocess explanations 
rather than by asking students to respond to process questions. For 
example, the teacher could ask, "Who can tell me what zero times seven 
is?" The teacher surveys the room and calls upon Bill (who may or may 
not have his hand up). When Bill says "zero," the teacher could respond 
with something like. "That's right. Bill, the answer is zero. Whenever 
zero is a factor, the product is always zero." By actively verbalizing 
and demonstrating (e.g.. writing problem solutions on the board, etc.), 
teachers can help students to achieve process understandings in a very 
efficient way. Still, it is useful to ask process questions occasionally 
to assess student understanding. However, if asked properly, product 
questions can provide information that assesses the student's ability 
to relate ideas, transfer concepts to different situations, and under- 
stand the process sufficiently well to solve problems. Product questions 
can also provide all students in the class (or group) a chance to practice 
the computation. This is especially true when the teacher asks the question 

ERIC ^ 



first and then calls on a student. If a teacher names a student and 
then asks the question, many of the students will not perform the 
calculation (that's Mary's problem). Similarly, if teachers hold non-- 
volunteers accountable on occasion, it increases -the number of students 
who are likely to think about the problem under discussion. 

Although a major goal of the development portion of the lesson 
is to strengthen students' conceptual understanding {\i'ny) , ihis goal 
can be achieved with a heavy use of product questions. The usefulness 
of product questions is due to the following factors: (i) they typically 
elicit a quick response from the student (and quick feecbacK from the 
teacher); hence, more material can be covered in a given amouni of time; 
(2) they provide more practice opportunity for a broader number of 
students; hence, a teacher's diagnosis is not limited to the responses 
of a few students; (3) and they help to create a "can do" attitude on 
the part of students (a series of quick questions that the students 
respond to successfully). However, it is desirable to ask process 
questions and enter a diagnostic cycle (reteaching) when students 
respond to product questions incorrectly. When students miss the same 
type of product questions, then it is useful to stop and review the 
process and ideas behind the computation. To reiterate, process ques- 
tions can and do play a valuable role in successful mathematics teaching 
although they should not be overused. 



130 



Appendix B- 
Typical Homework Assignment 



Reproduced below is a page from the fourth grade Holt Mathematics 
textbook. An appropriate homework assignment would be to assign problems 
#4-18 (evens). The ren^aining problems could be used in connection with 
the development or seatwork portions of the lesson. Appendix E shows how 
these same problems could be put in a different' format and thus provide 
some variety in your assignments. 



EXERCISES 



Add. Look for paUerns. 



Solve these problems. 

15. 17 cents for candy. 

8 cents for gum. 

How much in all? 
25 cents 

17. 35 pounds of oranges. 

9 pounds of apples. 
How much fruit? 

potnids 



1 

f • 


3 


13 


23 


43 


73 




+ 6 


+ 6 


+ 6 


+ 6 


4- 6 




9 


19 


2!> 




TO 


2. 


4 


14 


24 


64 


84 




+ 7 


+ 7 


+ 7 


+ 7 


+ 7 




11 


21 


31 


71 


91 


Add 












3. 


41 


4. 65 


5. 


93 


6. 14 




+ 2 


+ 2 




+ 6 


+ 5 






67 




99 


19 


7. 


23 


8. 41 


9. 


65 


10. 84 




+ 8 


+ 9 




+ 6 


+ 9 




.11 


50 




71 


93 


11. 


84 


12. 36 


13. 


48 


14. 36 




+ 6 


+ 9 




+ 8 


+ 7 




on 


45 




56 





16. 76 players. 
3 more joined. 
How many now? 

79 players 

18. 24 bees. 
8 ants. 

How many insects? 

32 visccts^^ 
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Variety jn_ Assignments 



Frequently students can be freed from the somewhat boring routine 
of always doing problems from the textbook as their homework assignment. 
The assignment shown below is an alternate to tne typical row-by-row 
set of ccniputation exercises found in most textbooks, yet it accomplishes 
the same objectives in a more interesting format. Answers for the prob- 
lems are shown in parentheses. 



ADD to fino tne nissing garget values. For example, 32 woula oe 



the missing value in this example: 
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Appendix D 

Sys terra tic Processing Errors niustrations 

A systematic processina error is an error a student consistently 
makes on a particular kind of problem. It is different from making 
random errors. Sirole exa-^oles include always working addition from 
left to right or "borrcv/ina" in every subtraction problem whether or 
not It is necessary. Other cor.non examples are explained below. 

In each of the followlna situaticns, carefully analyze the examples 
and try to determine f-o error oattem. The.i check your work by 
reading the descrioticr of tne error cattern. 

Situation "1 

23 34 29 38 

+6 +9 +5 +4 

S5 T24" 79 7F 

ERROR PATTERN- In these nroblenis the student does not add straight 
down a column, out ratner adds tne nur.oer of tens from the first 
number to the units from t-s second nuroer. Thus, in example ri 
the 2 tens are added to the 6 ones to get 8 tens. 

Situation n 

53 '/ 86 95 31 

-27 -39 i27 49 

-14- -53 ^ ^ 

ERROR PATTERN:' In these problems the studant does not "borrow," but 
rather always subtracts the smaller digit from the larger digit. 



Situation #3 
7 

48 



5 3 5 

49 86 67 

7m- ^ bJb 

270 177 354 174 

7^ im ^ 

ERROR PATTERN: The first part of each P'-o^len, the multiplying by the 
ones is done correctly. However, when multiplying by the tens the ^ 
crutch number recorded from the multiplying by ones is incorrectly 
Ssed aga n pSr instance, in the first example, when mu tiplymg by 
?he 5 tens the 7 (carried over from the 9x8) is used again when the 
7 is added to 5 times 4 and the 27 Is recorded. 




situation H 



4 13 2 

26 83 38 53 

TriZ x4 x8 

^ ^ m m 

ERROR PATTERN: In these problemi the crutch is added before ruUiplying 
In the tens place, whereas the correct procedure is' to multioly and 
then add the crutch. Thus, in the first example the 4 is added to the 
2 and then this sur multiplied by 7. If this problem was done correctly, 
the 2 is multiplied by the 7 and then the 4 Is added. 

Situation »5 



44 14 87 39 

2/88 4/W 3/m 5/m 

80 160 210 450 

8 ~T ~N 15" 

8 4 24 15 



ERROR PATTERN: These problems are worked correctly except that the 
quotient figures are written from ri '-^t to left. Consider the tnird " 
example, there are 7 threes in 23, but the 7 is recorded at the extreme 
right, rather than above the 3. 



Situation #6 



32r 3 78r2 94r2 

ymr e/mo 

27 42 54 

18 48 24 

"3 ~? "? 



ERROR PATTERN: In these problems, v/henever the students brings down 
and cannot divide, he brings down again but forgets to record a zero 
In the quotient. 
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August 25, 1977 



Dear Parent(s) : 

As part of the fourth grade math instructional program 
this year, I will be regularly assigning some work for the students 
to conplete at home. It should take your son or daughter about 
fifteen minutes to^ complete ^his homework. .If you find that it 
regularly takes considerably longer for him/her to finish this 
assignment or the assignment causes other difficulties, please 
let me know in that I may be assigning too many or too difficult 
problems. ' 

Programs in other school districts, educational research, 
and common sense indicate that the more a student practices important 
math concepts and problems, the more proficient he becomes in essential 
math skills. I view homework as an opportunity for the student to 
practice the concepts and skills that he/she has learned in class. 
I hope that you will encourage your son or daughter to complete every 
assignment to the best of his/her ability. Parental supp^rc is very 
helpful. Thank you for your cooperation in this matter. 

Sincerely, 
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Appendix £ 

Teaching Groups in Schools Using a Departmental Organization 

The emphasis thus far has been placed upon teaching mathematics 
to the class as a unit. We feel that many of the principles presented 
(the importance of development, the use of controlled practice and seat- 
work, accountability, etc.) will transfer to classrooms in which teachers 
are teaching groups of students. In applying these principles to a group 
situation, teachers will have to adjust them to their teaching situation. 

In general, we are not enthusiastic about the use of two or 
more groups to teacn mathematics. Three recent and major research 
projects have snown that third, fourth, and fifth grade students appear 
to benefit more from whole class instruction than they do from individual 
or group instruction. Although the precise reasons for these differences 
are unknown, we suspect that students learn less In group and individual 
settings because tney have less direct developmental work with the 
teacher. Also, the extra transitions (teachers moving from group to 
group) probably results in the loss of time that could have been used 
for Instructional purposes. Furthermore, student work is probably less 
effective when the teacher is not available to supervise work. 

If the differences between groups are not great, we strongly 
recommend that the class be taught as a whole class. However, we under- 
stand that sometimes the differences between students in a given classroom 
are so great th^ grouping Is a practical necessity . 

If grouping is necessary, you should attempt to limit yourself 
to only two groups because the transition and supervision problems that 
accompany the use of more than two groups are normally very difficult to 
justify. 

1:.. 
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Since teaching circumstances are so varied (sometimes the dif- 
ference between two groups is moderate but in other classrooms there are 
vast differences between the two groups), it is impossible for us to 
describe a plan that would be best in all situations. Still, there are 
a few key things that we would like to emphasize. 

First, whenever possible, we think it will ^e useful for you to 
teach the class as a group. Students learn a great deal from teacher 
illustrations and explanations. Perhaps the easiest way to do this in 
a group situation is by holding comnon reviews from time to time. The 
review might be a short-term review for the lowest group and a long-ten:i 
rev^w for the highest group. 

An especially good way to conduct a comncn review is through the 
use of mental computation problems. We strongly reconmend that each day 
of the week but Monday you use the first ten minutes of the class for 
review with mental computation problems. As we have noted earlier in 
the handbook, we feel that mental computation problems are a very impor- , 
tant addition to an instructional program. 

Second, we would like you to set aside each Monday for a review 
session. After spending theJ^irst five minutes on mental computation, 
review ideas and skills that are needed by both groups. Then involve 
one group in a seatwork review, then begin the developmental review 
with the other group. Roughly half way through the period reverse the 
roles; give group two a seatwork review assignment and begin an oral 

review with group one. 

To maximize the value of this review, a^homework assignment 
containing review problems should be given the previous Thursday. Your 
analysis of these papers should suggest the topics and skills that should 
receive emphasis in tha Monday review. Besides the homework assignment 

1 ^ ^ \ 
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each Thursday, we request that you assign homework three other days per 
week. Remember that these assignments are to provide brief , successful 
practice . 

The third request is that you maximize the amount cf development 
time for each group. The exact amount to be given to each group will 
necessarily vary depending on the topic being considered and the group 
Itself; however, the importance of development work for both groups 
cannot be overemphasized. As you do the development work, remember the 
guidelines previously discussed. For instance, teacher explanations 
and illustrations are important, especially initially. Also, process 
explanations are very important and often times are related to efficient 
use of limited instructional time. 

Finally, we asi^tHat you implement other recommendations as reg- 
ularly and consistently as you can. Little things are important (e.g., 
getting all students started on seatwork before doing other instructional 
tasks) and we hope you will carefully review the ideas presented In the 
handbook with an eye toward applying them in your classroom. 
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Appendix 2 



Student Types and Effects of 
Mathematics Program 



For more 'details, the reader can consult Beckerman (1981), 
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General Purpose 

Ihe results reported here are from Dr. Terrill Beckerman's doctoral re- 
search (1981), and the interested reader can consult his dissertation for 
an extended discussion. This study was similar to Ebmeier's dissertation 
(1978), which described the main and interactive effects of a treatment 
with derived student and teacher types. In the Ebmeier study students stated 
preferences for a variety of contextual and personal situations, including 
the amount of structure desired in math and the type of classroom environ- 
ment preferred. These preferences were used to derive student factors. Stu- 
dents were classified according to factor analyses of student self-report 
information, and significant main and interactive effects were found for 
student types and treatment effects, 

Beckerman used the same sample in his study (the same treatment was 
administered, the same observational data were available, etc); however, 
in his study, student types were identified by classroom teachers. His 
research was based upon studies that had examined teacher attitudes towc'^rd 
students (Jackson, Siiberman, and Wolfson, 1969; Silberman, 1969; Power, 
1974; Good and Brophy, 1972). 

Jackson et al, fl969) formed four student typologies from teachers' 
previous descriptions of students: attachnenr, indifference, concern, and 
rejection, Siiberman n969) asked teachers to identify one student whom 
they felt represented each of Jackson's student types. He observed the 
interactions of ten third-grade teachers with the students they liad categor- 
i/.ed. Each class was observed for twenty hours, and the analysis of the 
data suggested that teachers interacted differently with each of the student 
types , 

Good and Brophy (1972) replicated and extended the work of Siiberman 
with observational research on these four types of students in first-gr.ni^ 
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classrooms. Their results were similar to those obtained by Silberman. 
Silberman had collected his attitudinal information before observation; 
whereas Brophy and Good collected theirs after classroom observation. Appar- 
ently teacher behavior was not influenced by the fact that teachers m the 
Silberman study were asked to classify their students before the study. 
Good and Brophy also obtained differential teacher interactions with the 
student types m schools having different SES population. The patterns of 
teacher interactions with the four types of students appeared to be indepen- 
dent of school context. 

Power M974^ conducted a study of the effects of teacher-student inter- 
action, student characteristics, achievement, and attitudes. A battery of 
tests measuring twenty-three pupil cognitive, instructional, and personality 
characteristics was administered to 150 grade A students. A second battery 
of tests which measured ten outcome variables (including achievement, atti- 
tudinal, and sociometric variables) was administered at the end of the 
school year. Through a series of canonical analyses of the ten outcome vari- 
ables with the twenty-three pupil characteristics, four student types 
emerged: success, rejection-dependency, person-orientation, and social 
or i entat ion. 

Thre^ of Power's derived student types closely corresponded to three 
of the student types reported m the Jackson et al. study, Jackson's re- 
jected student is similar to Power's alienated student; both of these stu- 
dent types ci^e seen as overwhelming and frequent causes of behavioral pro- 
blems within the class. Power's dependent student is similar to Jackson's 
concern student, and Jackson's attachment student and Power's success stu- 
dent also have like characteristics. 

Load and Power ( l^lb) attempted a synthesis of the work of Jackson, 
- .^*;r-ian, and Power. Ihey added a fifth student type (phantom) to the four 
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student types researched earlier (J.ckson, Silberman and Wolfson, 1%9; 
Silberman, 1969; Good and Brophy, 1972). It appeared that the types of 
students described by teachers and the types of students derived by exam 
ining student preferences, achievement, and personality characteristics 
could be summarized xnto five types. A brief description of these t ivc> 
types of students, based upon the work of Good and Power (1976), follows 

Student Types : 

1- Success students. These students are essentially task-oriented 
and academically successful. They are cooperative in class, 
tackle almost all questions, and create no discipline problems. 
The teacher is more likely to direct more difficult questions to 
them, and they get most of them right. Success students like 
school and tend to be liked by both teachers and peers. 
2. Social students. These students are more person- than task- 
oriented. They have the ability to achieve, but value friend- 
ship more than school work. They are likely to get called on 
fairly often by the teacher to help them become involved and be- 
cause thev are able to answer easy questions. However, some o£ 
their answers are incorrect or irrelevant. Also, social students 
are among those most likely to be criticized by the teacher. 
While they are fairly popular and have many friends, some social 
students are not well-liked by their teachers. 
3. Dependent students. These students are the clinging vines of the 
classroom, always looking for teacher support and encouragement, 
asking for direction and help. They are frequent hand-raisers, 
more likely to guess and make errors, and make extensive but 
rouKhly task-appropriate demands on the teacher. Most of these 
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students achieve at a low level. Teachers generally express concern 
regarding dependent Students while their peers reject them. 

4. Alienated students . These students include the disadvantaged and 
the reluctant learners. In the extreme, they reject the school and 
everything it stands for. This rejection may take one of two forms: 
open hostility or withdrawal. It follows that they are either highly 
aggressive and create serious behavior problems or they withdraw 

to the fringes of the classroom and are ignored by the teacher 
entirely. Teacher attitudes usually reflect rejection or indiffer- 
ence . 

5. Phantom students . In most instances, these students are neither 
seen nor heard in the classroom. They are about average on every- 
thing but involvement in public settings. Some of them are shy, 
mousy students while others are quiet, independent workers of aver- 
age ability. They are rarely actively involved in class or group 
activities, never volunteer, and never create problems. The teacher 
will have trouble remembering who they are and express attitudes 

of indifference toward them, as will their peers. 
Approximately ten weeks after school began, control and treatment 
teacners were ^iven Power's student descriptions and were asked to classify 
their students. In addition to the five typologies, a sixth classification 
was\included tor students who did not fit ary ot the other five descrip- 
tions. Only fourteen students out of a sample of over 500 were classified 
.iS not b^flon^mg to one ot the five types. All teachers except two felt 
that the five types were quite appropriate for describing students. Two 
teachers who said they had difficulty classifying students were dropped 
from the sample m an effort to include only those teachers who felt that 
thev understood the rating form. 
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Interaction of Treatment: With Student Types 

A three-way, completely crossed-factorial design was used £or the ' 
analysis. The independent variables were treatment, student type, and 
sex. The treatment variable had two levels: one level represented the 
math program (Good et al., 1977); the second level represented the con- 
trol group. The student classification had five levels, each represent- 
ing a different student typology. Sex was included as a control variable, 
to determine whether the treatment of student types interacted with the 
sex of the students in the study. Separate three-way models were used for 
analysis of the two dependent variables, the measure of student achieve- 
ment (residual SRA score), and the student attitude measure. It is beyond 
the scope of this report to fully interpret and discuss the data, although 
much of the relevant data is presented in Tables 1-4. Again, the inter- 
ested reader is referred to Beckerman (1981) for further details and dis- 
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As can be seen in the tables, there were significant main effects 
for treatment types and student types, but not for sex, when the SRA 
residual scores were used as the dependent measure. All five student types 
obtained higher mean SRA residual scores in the treatment classrooms than 
m the control classrooms. It could also be seen that both males and 
females benefitted from being in the program. A tew brief comments about 
each of the student types follow. 

Success students had the most positive achievement gain of the 
five student types in classrooms implementing th^ mathematics program. 
On the basis of these data, it could be concluded that h igh-ach le v , ng , 
high-ability, independent students have better performance in a highly 
structured, briskly pace.!, aad teacher-directed learning setting than do 
Other students. 
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Social students in the treatment program also had greater gams 
than were predicted and also significantly more positive attitudes than 
social students m control classrooms* Beckerman suggests two possible 
explanations for these results. He argues that the highly structured, 
formal setting led social students to have more successful academic exper- 
iences than they had in other educational settingb. Albu, the teachers* 
checking ana recording of students' successful performances further moti- 
vated students to continue academic work. He suggests that a second expla- 
nation tor social students' improved performance and more favorable atti- 
tudes relates to the high participation aspects of the treatment. He 
writes, "The mathematics program advocated frequent teacher-student inter- 
action throughout the review and development sequences. The mental compu- 
tation exercises which occurred within the review sequence were conducted 
totally through verbal interaction. A general criticism by this investi-- 
gator/observer concerns the mental computation exercises. Classroom obser- 
vation of this exercise indicated that generally only about half or less of 
the students were actively participating, because the questions were too 
difficult for the majority of students to solve quickly. For the high 
achiever m general and the social student, who prefers to interact, this 
would be a positive situation. Perhaps a social student frequently inter- 
acts in non-academic ways, because a typical classroom does not provide 
enough opportunity for them to interact in academic ways. The positive 
correlational finding for mental computation and review (though not signi- 
ficant) combined with overall analysis supporting the program in general, 
support the hypothesis that the high participation aspects of the pro- 
gram was particularly beneficial for social students," (p- 112). 

beckerman also provides a brief rationale for the effects of the 
pro't^^rarr^ on rl^,pendent, alienated, and phantom students. This material 
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follows. "The dependent student type had both better and slightly higher 
than predicted performance in classrooms implementing the program. This 
_ student type was described as a very conforming, highly anxious, low- 
achieving student who makes frequent demands upon teachers for individual 
help and/or reinforcement. Prior research indicated that this type _of 
St.Kjent performed well in high-structured, high-participation setting, 
where the objectives were clearly organized and described. In particu- 
lar, results from the Whitzel and Winne (1976) and Bennett (1976) studies 
indicated that low-achieving students had better performance ir an .r.divid- 
ualized setting with the objectives being matched to the individual's 
ability and the environment was student-centered. Perhaps a brisk pace and 
objectives were more appropriate for higher achievers. However, the home- 
work assignments (significantly correlated) provided additional practice 
needed to comprehend objectives and to keep up with the brisk pace main- 
tained in the classroom. 

I 

In general, the program is a very positive learning environment for 
the depMident student type. However, teachers should be cautioned not to 
increase the pace in interactions with other student types at the expense 
of the dependent student. That is, teachers should maintain a brisk pace, 
but also provide increased amounts of individual teacher-student inter- 
action with the dependent student. 

Ti.3 alienated student type had greater performance in program class- 
rooms than in control classrooms, but still perf,|rmed much lower than 

I 

predicted. The program was least successful with this type of student. 
Prior research, particularly the Bennett (1976) findings, indicated this 
type of student has better performance in an individualized setting, where 
the curriculum and objectives are matched to the individual's pace and the 
program is student oriented (i.e., affective/aesthetic). 
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Homework was positively related to the achievement of the alienated 
student. That is, homework is advantageous and enhances the achievement 
of the student type. However, the negative residual score, and negative 
correlations of the observational data indicate program modifications are 
necessary to significantly improve the performance of the alienated student 
type. These findings in conjunction with prior research findings (Bennett, 
1976; Ebmeier and Good, 1979; Solomon and Kendall, 1976) suggest that the 
program should be more individualized for this student type. Perhaps indi- 
vidualized workbooks and assignments, in connection with more opportunities 
for the student to work independently (i.e., less teacher interaction) will 
provide a beneficial environment. 

Interestingly, the phantom student had better performance in the mathe- 
matics program classroom than in the control classrooms, yet significantly 
more negative attitudes. However, while achievement was better in the pro- 
gram classrooms, it was still slightly less than predicted. The low- residual 
score and negative attitude findings suggest that the mathematics program 
should be mo<Jiried to some extent. The phantom student was, in part, de- 
scribed as an independent^ student of average ability/achievement. Relevant 
findln^s from pr^or research (Peterson, 1976; Bennett, 1976; Solomon and 
Kendall, \91h) described a high-structured, low-participation, formal set- 
tin as a n^ore beneficial environment, compared to individualized, informal 
or high participation settings. In general, the mathematics program was 
described as a high-participation, teacher-directed, formal-instructional 
svstem. In particular, the program cal led for frequent teacher-student 
interaction and accountability behaviors. Relative to the phantom student, 
the encouragement of frequent teacher-student interaction possibly had a 
-^ore 'let r 1 fent a I influence, particularly upon their en|oyment of the math 
class M.e., their attitude), than a positive influence. 
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Correlational results indicated the checking of homework was possibly 
associated with achievement of this student type. The general implication 
of the findings may be that the phantom students prefer teacher recognition 
of their performance but not through public interaction (this material was 
drawn from pages 113-115 in Beckerman's dissertation). 

' Direction for Future Research 

These results, along with those presented earlier by Ebmeier (1978) 
and Ebmeier and Good (1979) indicate that the mathematics treatment program 
we experimented with was generally successful. That is, students in all 
cases made more gains in the treatment classrooms than they did in the con- 
trol classrooms. However, in some* cases, rhese were important beneficial 
gams but for some types of students (particularly in combination with cer- 
tain types of teachers), t;he gains were not particularly ..nportant or im- 
pressive. We feel that what is needed at this point in time is a very com- 
prehensive, analytical' examination of the interactions of different types 
of programs with different tvpes of students. The field has started to pro- 
duce some interesting experimental programs, but we need to begin to inte- 
grate and consolidate these findings Across studies and look for their 
implications tor teaching. An example of^ what this integration might ulti- 
mately look like IS provided in a brief table that Beckerman prepared (see 
Table 5). To reiterate, what we need now.is, a very careful integration of 
available results a.id then to begin to d^'vise studies that experimentally 
test some of the hypotheses that emerge fromthis synthesis. Performing 
this syntehsis will be a very difficult, analytica-1 task because treatments 
vary in their composition from study to study and- alSodefinit ions of stu- 
dent types use different operational procedures . .Nonethg less , it se^ms. 
in^portant to begin such work prior ,to.the collection of new data efforts. 
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It will nor be easy to make detailed comparisons across different 
studies for a varietv of reasons. For example, in Beckerman's research 

the teachers who classified studeiits according to the five types 
assigned students disproportionately. In particular, 249 students were 
described as success students, 147 students were defined as social stu- 
dents, ^0 students were defined as dependent students, 43 students were 
described as alienated students and 69 students wf^re described as phantom 
students. Teachers in different populations might assign more or less 
students to particular cells, and indeed even in this study teachers showed 
iTidividual differences in the number of students that they assigned to the 
five types. Although such categories are helpful in getting the phenomeno- 
lo^-ical reactions of teacners to students, they also make it likely that 
definitions will vary from teacher to teacher and sample to sample, depend- 
mk' upon the relative standards that teachers impose. 

Tn future research, it may be useful to have teachers use some sort 
of distribution for classifying students. Also, it may be useful to experi- 
ment with having feachers identify only two or three students pc^L category 
m order to Keep the typology as pure asr possible. Given that teachers' 
I'efinitions ^n defining students and the criteria they impose in assigning 
srude-its frcells mav vary from teacher to teacher, it is very difficult 
to rell how closeiv teacher-assigned categories parallel typologies derived 
>sir_ of'^r so-irces. Indeed, treatment variations vary widely from study 
to st'j'''v ^ni vhat one investigator calls open may be relativeiv structured 
n ,\ 'i^^'ereut pop'ilation. Also, when data are broken down by achievement 
le\el , ^'sat is a ^roup of high-achieving students m one study may corres- 
,,,3^,' r^o'^e r^osniv to the absolute achievement level of students classified 

nc-. p'^prs 1:1 Other work, Ae,ain, such comparisons will not be easy 

\ ^^ t s^e-^ t'f'it t^^' ?ie]d IS ready for some synthesizing that will 
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pWha,,. «.„„ate; ,„pothese, that e.„ be tested .„ t.,e future ,„d such sy„- 
thesi,,„, „o,. „„„ ,,,, researches to be«.n to ,„pos. a „„„ sta„<iard 
a:.d ,n»re r>„oro„s >,e,.„.t.o„ of the populations they are wor.,„, „uh. 
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Table 1 

Ar.aiys-is of Variance 
iMeruent Varu-hl --SHA Rob^diial Scotgs 










SS 


f7 


n 






1 


83B 


2G.10 


.001 


Sti:c!or.t '3 




4 




6.84 


.00^ 


Sex 




\ 


6?. 


1.93 


.17 






4 


45 


0.35 


.84 


Tr^atPiC'.i" X Sex 




1 


14 


0.44 


.51 


StLiclent "ype x Sex 




4 


19 


0.15 


.96 


Treatment X J i-L'0t3i">'t 


Type 


4 


62 


0.48 


.75 


X Sex 












Error 




578 


188558 
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Table 2 

'.-'iji Sc?-e5 rcr -S? Three I-(dopc"->d?:it Variabhs-- 
ent T^n^ . Shjc-nt Tyre a,id Sox Typ-j 



•'-^ 370 1.42 

C-.ncvYi 228 -2.00 

Studjnt Typ'? 1 249 1,52 

Student Type 2 147 -0.27 

Student Type 3 90 o.^^5 

Student Type 43 .3 12 

Student Type 5 ' 69 -1.38 

'I'^-'-^s 306 ■ 0.52 

ronales 292 .0,27 
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Table 3 





0 -'■'U- - - ' 

r r •,' J 1. ct:; 


J '^cci-.is -ror Stu-ient 
Ccn'fCi Ci^ssrooriS 


Types 


Student T/ 'jZ 




X ::ontroi y 


Oi fference 


Success 


2.72 


-0.60 


3.32 


Social 


0.99 


-2.97 


3.96 




0.5f. 


-1.96 


2.52 


Alienated 


-1.14 


-4.68 


3.54 


Fha.Uom 


-0.37 


-2.61 


2.54 



erIc 




»er|c 



iccjSs Social Dapendent Alienated Phantcm 



Table 4. Co-inarison of f'ran Residual Sf-l^ Scor^z for Five 



Table 5 



CH ARACTERISTICS 
Success Student 

1. High Achiever/High Ability 
c. Independent/High Achiever 

3. Type 1 

4. Cluster 1 and/or Cluster 5 



AUTHORS 



(Whitzel and Winne, 1976) 
(Peterson, 1976) 
(Bennett, 1976) 
(Solomon and Kendall, 1976) 



MOST BENEFICIAL ENVIRONMENT 



Fast paced setting, high structure, 
low or high participation, whole 
class or traditional approach as 
opposed to an individualized setting. 



it:. 



Social Student 

1. High Ability 

2. High Ability 

3. Type 8 

4. Cluster 3 

5. Type 4 

Dependent Student 

1. Low Achiever 

2. Low Ability, Conforming High 
Anxiety 

3. Type 4 

4. Type 1 

Alienated Student 

1. Low Achiever 

2. Low Achiever, Low Anxiety 

3. Type 7 

4. Cluster 2 

5. Type 3 

Phantom Student 

1. Independent, Quiet 

2. Type 5 

3. Cluster 5 



(Whitzel and Winne, 1976) 
(Peterson, 1976) 
(Bennett, 1976) 
(Solomon and Kendall, 1976) 
(Ebmeier and Good, 1979) 



(Whitzel and Winne, 1976) 

(Peterson, 1976) 
(Bennett, 1976) 
(Ebmeier and Good, 1979) 



(Whitzel and Winne, 1976) 
(Peterson, 1976) » 
(Bennett, 1976) 
(Solomon and Kendall, 1976) 
(Ebmeier and Good, 1979) 



(Peterson, 1976) 

(Bennett, 1976) 

(Solomon and Kendall, 1976) 



Fast paced setting, high structure, 
high participation, whole class or 
traditional approach as opposed to 
individualized, student centered, 
approach. 



High structure, high participation, 
traditional or formal approach. 



A low participation, individualized 
setting, emphasis upon affective/ 
aesethic rather than cognitive. 



A low participation, high structure 
setting. 
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Appendix 3 

Analysis of Fourth-Grade Mathematics Treatment Program Effects on Students 

At Different Achievement Levels 
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The data briefly reported here a<idress the question of differential impact 
of the fourth-grade treatment on different ability students. The students were 
divided into quartiles .(on the basis of their pre-achievement scores) and that 
classification was used as an independent variable along with status (treatment or 
control) with residual achievement serving as the dependevnt variable. 

There was a strong main effect for status (p = .0001). Students at all 
achievement levels benefitted from treatment versus control status. There was a 
weak main effect for achievement (p = .08) and no interaction effect (p = .53). 

Although the main effect for achievement is very weak (p = .082), it does 
merit comment. From the examination of the mean scores (see Table 1), the treat- 
ment seemingly had the most impact on the slightly below average students. It 
should be noted that this effect was very weak and also that the analyses reported 
here are based upon using the student as the unit of analysis (which tends to exag- 
gerate effects). In reporting the treatment effects in the fourth-grade study (see 
the body of this report for those results... or see Good and Grouws, 1979, Final Re- 
port), the classroom was the unit of analysis used for making judgments about the 
effectiveness of the program as a whole (a more conservative approach). However, 
here we were looking at the effects of the program on students at different achieve- 
nient levels across the sample as a whole and using the students as the unit of 
analysis see^s to be an appropriate way to make this judgment. 

Such data suggest that the treatment had generally positive impact but that 
some students benefitted more from the program than did other students. More details 
of this analysis as well as comparable data for the sixth- and eighth-grade treat- 
ment programs will be presented subsequently (Good, Grouws, and Ebmeier, in 
progress) . 
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\ Table 1 

Students' Residual Mean Scores on the Basis of Student Ac+iievement 




on the Pre-Test and as a Function of Program Participation 



(Treatment or Control) 



Treatment 



Top quartile 
Next quartile 
Next quartile 
Lowest quartile 



1.66 
.75 
2.58 
1.57 



Control 



Difference 



-1.53 

-1.35 
- .95 



3.19 
2.76 
3.93 
2.52. 
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'^\^rbal Problem Solving 

Iptroduction 

There are many reasons for teaching students mathematics and different 
people stress different reasons as they testify to its importance. On one 
thing, hcvever, there is universal agreerent: mathematical problem solving 
is of para^ount importance: This agreement stems from the fact that many 
real world oroble^-s are -est easily solved by expressing and treating them 
mathematically. An imoortant step toward developing problem solving ability 
. in students is to help them gain competence in solving verbal problems. By 
verbal problems we mean those problem.s which are comrnonly referred to as 
"story problems" or "word problems." These are the problems that are tradi- 
tionally found in contemporary student mkhematics textbooks. 

. In the past, instruction on verbal problem solving has amounted to 
little more than the teacher solving a few sam.ple problems in front of the 
class and then asking students to solve similar problems on their own. 
usually such instruction is grossly inadequate; students do not understand 
the assignm,ent and are not able to do the problems successfully. Because of 
such poor presentation m.any students develop a perm.anent dislike for these 
problem.s. This situation is particularly unfortunate because research has 
shown that there are a number of instructional strategies that can be used to 
improve student problem solving perforr.ance significantly. The remainder of 
this manual is devoted to describing techniques that can be incorporated 
successfully intc daily instructional practice. When these techniques are 
used systematically we believe that students' ability to solve verbal Prob- 
lems will show steady progress. '-^ ■ 

I„ particular, it <s important to Include so.e worK on verbal problo. 
solving each day. Too uften verbal problem solving ii taught only three or 

ErJc IV. 



four times a year as a special topic. However, it is only the day to day 
brief but systematic exposure that will allow students to become proficient 
in solving rr.atheir.ati cal proble-'s. 
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ProblG;ns l/ithout IJir-bers 



The use of proble-s with- umbers is a very effective instructional 
technique for irorcving ver. em solving performance. It provides 

students an opportunity to gain insight into the problem solving process by 
avoiding the use of r.-.bers and thus the need to perform any com.putation 
whatever'. 
Exarpl e 

To illustrate the r.eth.od consider the following typical problem.: 

Tv/o classes scld ICO football g^m.e tickets. 

One class scld 27 tickets. 

How m.any did the other class sell? 

(Holt School I'athe-^f'cs , Gy-sde 6, p. -i^l 

This problem can easily be rephrased so that it is a problem without num.bers: 

Our class and Mrs. Sm.ith's class sold tickets. 
We know how many tickets were sold altogether 
and how many tickets our class sold 
How many tickets did Mrs. Smnth's class sell? 

The teacher presents only the problem without num.bers and asks the class how 
to solve it. An appropriate answer might be som.ething like this: "I'd sub- 
tract how many tickets we sold from the total num.ber of tickets to find how 
many tickets Mrs. Smnth's class sold"." Tim,e .permitting, the teacher should 
follow-up with another problem without numbers or occasionally consider the 
same problem only with the num.bers included. 
Rationale 

The specific reasons why this technique is effective are difficult to 
isolate. Cne reason for its effectiveness m.ay be that it causes students to 
focus exclusively on the method needed to solve a problem without any numeri- 
cal or computational distractions. Many teachers realize that too frequently 
stude-.s begin doing the computation before they have really thought through 
the problem. In fact, som,e students have been known to begin computing before 
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they hu'.e r"uJ t''£ (■rlire pi-cLl ci ,1 /".voidii-.n the use of nui-,bers tends to 
resolve t-co kinds of pi-oMe-"S. Since tho strctcgy doc-L not require cosipu- 
tation, stuLlef.ts c:--n be exposed to a suust^intidl nuiTiber and variety of verbrl 
problG'S in a shcrt period cf ti^^e. 
Imple-cp i : j^t^ 

This techr-:-e s;,.j"Ij be '.id fi._:, .ently cs part'of a cc" prcher.r.i ve 
effort to ^ • rove . /i ; c:le 'i' '.Mils. It see.vc esp:cTany Lffcc- 

tive ii" tc:cr.-rs ^ ^'"l" 3 :c : j u:bd ly reccslliig vcu;1 i^rc 1 i:ir.s 

fciird in f-j st.:v-. '.z.-.. r ^Z.;. I: is eii.e heipfjl if i\v- pr^j'c : aro „rit- 
ten dc. ■ c-i r',.'y - :•;-.£. ,'-t-.i-::: pr-- to t,-,.. tegirnir.g of r^ith period. 
This alio.,: e-Tioe . ..se e'-.e e.aT:.v<^,e instructional ti-e. 
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Writing Verbal Prob1er::s 

Research has shov/n that when students create and write verbal problems, 
their problem solving ability irproves. Certainly a coir.prehension of what con- 
stitutes a problc-r, is necessary in order to succeed at writing problems, and 
this is t'jrn may be a vital ccrponent in learning to solve verbal problems. 
Example 

There are a variety cf interesting formats that a teacher may use when 
having students write verbal problems. Qr.2 method is to supply data and ash 
students to m,a'-;e up their own problems based on this inform.ation. For exam.ple, 
the data might consist of a football team roster like the one below. 



Number 


PI ayer 


Position 


Year^ 


Heiaht 


Weiaht 


11 


Anderson, Bill 


Quarterback 


9th 


5'B" 


155 


24 


Baker, Burt 


End 


Bth 


5'7" 


140 


17 


Brunson , Jim 


Quarterback 


8th 


5 '5" 


135 
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To illustrate the kinds of problems that may be written, the teacher could sup- 
ply exarples like the following which range from the easy to the com,plex: 

Bin ^ndf^rson and Jim Brunson are both quarterbacks 
on 'the Kerorial Junior High School fcctball team. 
Bil I weighs 155 pounds and Jim weighs 13d pounds. 
Bill weii/'-s hew much more than Jim? 

There are three quarterbacks on the Memorial team. 
Jim weighs 135, Bill 155, and Sam 130. 
What is the average weight of the quarterbacks. 

All 33 players on the Kem.orial team are going on the 
bus to the away game with Fulton Junior High. 
Hiah.vay 2^* is the shortest way to Fulton, but the 
Mason Creo'- bridge on this route limits loads to 
I'-'SS t^^-'n five tons. 

The ^us w-'-"h ^nc driver weichs 3200 oounds. 
w'ill \'e bus loaded with the ..layers be too heavy 
to use Highway 24? 



After sl'-:J'-nts havc tiad scr:.Q fcxporience writing problems, the teacher my 
allow thcr: to nake up profclens by supplying their own data from situations 
that are of interest to thc:n. Placing some restrictions on the problems to 
be written \;in help to keep this activity consistent with the operations and 
kinds of n.-bers currently being studied. For exarr.ple, a teacher might want 
to restrict t"C p ^Ll-^-^s v.ritten to those that can be solved by division of 
whole '■---e'-i cr to ircse involving addition and subtraction of fractions. 
Ratijrjjj^ 

Tiie valje or having students create verbal prcblerrs is clcscly tied 
to their si' j1 t:ne:".£ ccvelcp-ent of the ideas of inforn-ation given, info!^:.atic' 
to find, and a link or path fror, the forrer to the latter. V.'riting a problem 
requires attention to all three ccT.ponents. In the early stages of this devel- 
opnent a student rr.ay only consider the given aspect and write a "problem" 
like: 

Suzi has 9 packages of baseball cards. 
There are 12 cards in each package. 

As students progress in their ability to coir^prehcnd what constitutes a problem 
and thus the ability to write problems, there is likely to be some transfer to 
those situations where students are presented with problefr.s to be solved. This 
transfer rray be in the forr. of recognizing what is given, what is to be found, 
or that the ta<;k is to build a bridge or link between the t\;o. The importance 
of this transfer is erphasizod by the number of times we have all heard the 
comir.ent: "I really don't know where to begin." If teachers regularly have 
students write verbal problems, they should hear this quer.tion much less fre- 
quently. 
Imp! ementation 

This technique can be closely tied to instruction on any of the basic 
operations (addition, subtraction, multiplication, . nd division) as well as 
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most ot'v- tcpics. including measurerr.ent and geor.etry. Students raay be asked 
to write problers in class, as part of a homev/ork assignment, or both. 

Allowing students to solve one anothers' problems often stimulates 
their irt-est. 'Contests based on ideas like "stunp the teacher" and "problcn 
of the \;eek" also edd variety and interest. 
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Estir.c.ti pq _t!^ Ans'..'er 

Stude'nts \/ho estirite the cinsv.'ers to verbal problems before they 

atte-'-pt to solve trr seer, to n-,ake iriportant gains in tne ability to correctly 

solve prob"ic;;s. Use cf this technique is not difficult, yet the payoff fror- 
using it c:r, oe substantial. 
Exanpl e 

S_t'-;:;ents c:.- 'e asLec to c-stir.ate th.e ans;.'er to any verbal problem. 
Consider f-.i s prcL-"! . : 

Janet picked 17 d:r;sio3 for each of her 
cl r.S5' .-.Lc-s . S-i3 -^rd ciass-r-tes. 
\',o\: ranv c:isie5 c-,c sIt: pick in all? 
(nU :c:r: : "•'J'-.z :.ti c? , Gr:de 6, p. C3) 

Students ray estirate the ans\.er to be 600 by fcrnally thinking of the product 
15 X 40, or by infcr;rally thinking of 15 sets of 40. Another estimate might 
be 700 by thinking that the answer v/ill be so;T.ewhat less than 20 X 40. Each 
of these estirates is close enough to the exact answer of 6''6 to serve the 
desired purpose. 0^ course, students may esti.r.ate the ans\,'er in an entirely 
appropriate way that is very different from the formal and informal methods 
mentioned here. A discussion of the methods used to estimate a particular 
answer can be very enlightening for students and teachers alike. In partic- 
ular, such discussions provide an excellent learning experience for those 
students who have a poor concept of what is involved in the esti[,;<v. ^ on process. 
Rationale 

The benefits derived from using the estimation strategy may be due to 
•several factors. In order to estimate the arsv/er to a problem a student must 
comprehend, at least in an intuitive way, what the problem is about. This is 
an important first step in solving a problem. A reasonable estimate of the 
solution also suggests and eliminates certain computational procedures. For 
Instance, in the previously cited example the operations of addition, subtraction 
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and divi'Jo-> .re ruled out quickly since there is no v.^ay they can operate on 
the nur'jers the problem (17 and 38) so that the result will be anywhere 
close to a rcason::ble estimate; in fact, such operations would not even yield 

a thr-e-cigi^ ru-Derl 

Another factor which rr.ay contribute to the value of estimation is that 
it provides a safeguard frc- absurd answers and thus provides a means of detect- 
ing cc~:)utat-;cn er-crs. Although there n,.iy be other reasons why the estimation 
techVo.e is so effective, suffice it to say that the results are generally 



very pc5it"'ve. 



The estinuticn tech^.ique is easy to use and should be used in two 
distinct situations. First, it should be used regularly as an instructional 
method, perhap's by being a part of a regular rotation among other problem 
solving n^ethods. Second, once students are acquainted with the idea, they 
should be required to n^ake and record an estimate of the answer for every 
verbal problem they solve. Teachers are responsible for soliciting and dis- 
cussing estimates for all problems worked orally in class. They should also 
monitor seatwork and homework to insure that students are estimating answers 

in these situations too. 

One successful approach to m.cnitoring is to have students record 
their estimates and then identify them by underlining them. Exact answers 
are the^ either circled or underlined twice. 

It is important to em.phasize again that discussion of the various 
methods of making an estimate for a specific problem is an ideal learning 
situation for those students having difficulty with this technique. Teachers 
can al.o foster the initial development of this ability by thinking aloud as 
they their estimates as part of work done in front of the class. 
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Providiiiy '.'^-.ctice in rounding numbers and doing mental co.T.putation is also 
beneficial. A te:c!*:^ '"ust eK^pliasizo that in order for an estir.iate to be 
helpful it .St be Curofully r:de and not a "wild guess," Teachers can best 
do this e:\ ' ly in tn2 year by frequently n:odelling (thinking out loud)^^and 
clearly c cnstracin: to students how to make estimates. 

Cne final thought to keep in mind as you do estimation v/ork is that 
estiratv zir. ^.'\'^".r.al in nature and need not rely on forrrial calculation, 
e:-hor c* Recall that the product of 20 a. id '^0 can be 

thougn-. cr' in-'cr::;"/ rs 20 groups of 40, and the apprcxir.ate result :;aincd 
from rel '^z on c ::'s cusntitative sensG is usually accurate enough to serve 
the desire: p'j'^j:.cl c-ilined in this section. 
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Rpfldino yGrbaT_ Pj:cb]£2L 



The inability to read verbal problems is a definite factor in the 
difficulty nany s^ud^'.ts hive in learning to solve verbal problems. Thus a 
sustained effort to c'.orcc-,o reccing problens is necessary in order to im- 
prove verbal p.-cblc" sclvi-g ability sicni f icantly. 
Exar ple 

Trere are r-.y -rcccis to tne reading process that nust be taken into 
account t:^c i nstr.cJ cr.al process. To read well a student .ust be able 
not only to 'strin. ;::ros toucher," but also to ccT.prehend these words. 

Consider this pro'il-:-: , 

Th» Great "vr-sr.ib orioirally 181 feet taU. 
The Great ?vra~id i.:s as tall as a builuing o, 
ho, r^rs'-ries, if you use 12 fee: per story? 
(Addison 'rsley/lnvekioatiniS^^^ 
Grade 6, p. Kl) 

There are nany tinds of reading-related difficulties associated with verbal 
problen solving. An initial difficulty in the example problem night be with 
recoonition of words like "Pyramid" and "building." Another difficulty, 
associated- with a higher level of thinking, might be recognizing a word but 
not associating it with its approoriate meaning. In the example problem a 
student might incorrectly think of the word "stories" as being a collection 
Of narratives rather th-an a m.easure of the height of a building. Finally, 
evc' if the v;ords and their meanings are correctly discerned there is some- 
tir.o: difficulty wUh general comprehension, taong other things the student 
„ust realize what inform.ation is given and what is to be determined. 
Ratio nale 

,f a student cannot read a problem he is going to have groat difficulty 
solvug we now examine a method for handling these reading-related prob- 

1 ems . / ^ 



There are t\.'0 goals to be \.'orJ;cd on jointly. First, assistance must 
be given to studcnii to hcrlp thir] overcG-;e their reading problems. Progress 
on this c::.l is oriented tcv.ard a long term solution to the proilcnis, which 
in turn \;i 1 1 result in better prcbUn solvers. The second goal is to provide 
p-actice i solyiig ^erbcl 'jrcblc:r-,s which circurr.vent reeding di^iculties. 
TV-is is c. -'J by t; : tet:' :;' reaJ-iro prcbler.s aloud, using tepp recorders, ar.d 
so on. Tr2 secon: co:.l i"s: res t'-,:.t ii provement in verbal problem solving 

not r aC'e to \::it uniil tns reading difficulties are remediated \;nich in 
many cr.ses : :y in\olve e considerable period of time. 

Several thir/.s r\.st be done as pert of our regular m athematics 
instructic n rcrarcless of the particular topic being siudied in order to re- 
duce the possibility of, later reading difficulties. Terminology must be 
given special attention, Vihenevcr a new term is introduced it must be writ- 
ten on the board, carefully pronounced first by the teacher then by the 
students, and then its meaning must be carefully discussed. This discussion 
should include both examples and nonexamples of the concept and also distin- 
guish between the mathematical meaning of the word and any nonmatheniatical 
uses of tne word. For pxam.ple, the word Mane" has a special mathematical 
moaning quite di ff erent! f ron everyday use where it might designate an airplane 

or a hand tool . | 

Whenever verbal' problem solving is the to£2£ for a l_esson the 
teacher must take direct steps to deal with reading problems. This means that 
all problems presented jn the developm,ent part of the lesson and the first 
problem in any seatwork assignm,ent m.ust be carefully read aloud by the tea ' er 
or c student and important words and ideas discussed. An example of how this 
is done is described later in this section. Students must also be given 
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reading .-^s.r.tance on ir.ore than the first seatwork problem. A teacher cculd 
effectively .^dLe use of aud^io recordings of the pt-cblems, or provide reading 
assistanc2 as neeciod and requested during tha seatwork time. 

Special attention to reading problems alons should be included peri- 
odically c-ring t:v3 daily portion of the nathematics period which is devoted 
to proL'c- solvv-.c. This nay involve teachers and students alternately reading 
prcbic--:, ■..il''. ^. .-i-: sjv.sion of each proolcn after it is read. For exau'ple. 



in the r. 



' l.'eves as^nich as 112 feet h?vo been rerarted 

H^c\) seas." If eacn floor of a building 

is i^rfcet tail, the v:ave would be as t-:ll as a 

building ',;ith hew r.any floors? 

(/'.ddisc'i ',;cLley, I ! e s i i a t i_p_g_ School_ . ^r.. huPuiLics , . 
" Grade 6, p. iC9) 

several r.eanings of the word "wave" could be discussed, and attention would 
also be given to identifying the two pieces of infor.,ation given and what 
needs to be determined to solve the'problem. Problems to be read may be col- 
lected frc^i the textbook, teacher and student written problems, and problems 
from older textbooks v;hich are no longer in use in the school district. In 
order to focus priparily on reading, especially reading for meaning, problems 
read and discussed need not be solved. This allows for many probleras to be 
considered in a short period of time. 

Progress on reading difficulties should result from the above mentioned 
suggestions. Of course, progress can also be expected from students due to 
their regular reading instructional program. Certainly it is quite appropriate 
for r-^the^-atical rateria'l to be used as part of this instruction. Finally, not 
an students will benefit to the same degree from the attention to reading prob 
lems. but it will be a valuable experience for some students. 

.'nyone who has taught verbal problem solving is aware that reading prob 
le.,s v;hich\inder verbal problem solving do not appear in isolation. How many 



tin:es h.'^ - . 3 to a n3!irc?.Jo)^ and i.c still could not solve 

the probj. For ihis rc.scn attcniicn to reading is only one of the r.Mny 
in:Oortani :::hnir..cs V):i nast be cjveti rc.jular cttenticn in instrLXticn on 
problem. sciMn^. 
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V.'n'tino ?n 0 _S_?iit oiico 
;tential isnofits of pathCn\-\ tics leiraing are realized when 



n-ai.'^c^ :t"'c: is •.;^c:: to 



".any pc: 

to ••jzi: p!v,'^.ical situations, because it is in this i^ay 
that -«f: --Jcs is used to solve (^veryd^y proolcr.s. H.e sirplust sitv.tion 
where t-^s t^-.s place is .'er-e .n open sentence is. written to ropresort a 
-ow.^ -,r --i--,::l nu^:.:r of ccrrition^. Verbal prebl^ s 

r-ns s.-^-^ t-^ ^0-^0 rose- c;i ;\ 



can cfi::^'^ 



,^3,.,,: :v-tO'^ces is related to i::re-.cd ^rcblc:. solv:-^. p.rvo,-vrce. 

To illustr:.e he.; ar op.r senierce can be ^sed to '-cdel a verLc^ 
probic- or a real -orld situation, cc-sider this e;:a":r:le: 
{ir,e classes in the sC-eel^ravc a total cf 



$1 ,030 10 t' e Lcci; 



class c,:ve 



■ r n 



:ic e:. 



This pro-e. can be translated into .he oren sentence 9 / dd = ICSO. Tne 
.n..-.>^ -^re'-l^-r. is then found hy solving the oncn sentence usi'^g i- 

^ , ,c ,-ir.^^:cn or bv for-.al calculation or t'-e cueticrt 

1080 d^v'coc 
Rat""' '5 

with ..:ry other successful tec^nicues, this technique probably 
^ ^c'.;er by 'forcing the stu:'ont to read carefully and to cc " 

t'^, -eaning ci^ the pretlen. Tr;at is, it is necessary to deter- 
mine ;c • the given in-ur.atio;, pieces relate to one another in order to write 
an .p;.>-:priate oren sentence. Another reason for the usefulness of this 
^,tJ'.. v^at it reduces rr.enory load in con^.plex problcrr. situations. Given 

' ' .o., -,,vvirg rany conditions n is difficult, if not inpossible, 



.0 



a cc 



A. 



1 r) 

to n;ont. ^ jr, i; . ^'i rul d le, cc::\\w'e and ccntrasi thc^ (liv^.n coM^litions 
It on ti L i'.^::o coi.citio;iS are rcpt^L-sunuCd in It.j rori-i of a 

coilecli:': or cr:: znvXz^^z^s tv^z task hC'Con.es ^^i.ch i:.crc ir.anaccabl e. For 
exa-ple, z'^'Z :'c";i: I'^o .^xb'c; is di-rr^.ciiU Ic sotvo \;ithout liio u:e of cpni 
sentences. 

In crJ'jr to c..: a f:^:G aro^-Td 
t'..o c " "c.L o"" a rc'. "^C'-*"! 

Ic. . . ".^ . . . 3 ' !';^o/:c'. Ti.a 
. . : ' t;,: " : : ' ^ -'7 :c . . , j f ■ . 
, I : ^ ^ ^ : V 1 0 ~ Oac:i i . :i of 

L^>t X t ,2 To:;:..'', of ti.: t".o cdjiccnt sides. T'lon \ ^ y ' 

end X, ^ ^ir^l s:r.t- ' y = 32 - x a':d Jicn 

st'bstit. ^ to t':- :occ:-' soue',:o we nave ^ x) 217. This C3n 

now be solved ty :rial rn: error or rore forral rreans , but in either cai.e 
getting the proL^e.i into ranaoGc-jie forr.i involved \;rii:ing cp:n sentences 

(equations } . 
Irplerv n^r^ij^ 

This prohlcn solving n:ethod shoula be taught to all students. liopef-Jily 
rest students \;in already have had prior exposure to the technique and thus 
only periodic re/ie'.' v/ill be necessary in order for then to use the technique 
as they solve verba" ptoblc-.o. The pcM'iodic revio.; ccn be cart of a rotation 
among otr ^r tcof;^^■c,■Je3 describee; in this n.anudl and like the others can be 
dope daily osirg s-all port of the rrathen.atics olass p-ricd. 

When providing practice . translating verbal prcblcr.s to open sen.- 
tencos sev-ral irportant ideas need to bo reir.cr bcred . First, there v.'ill be 
d tendency for students not to write an open sentence for the very simple 
-iroblcr.s. The typical co:rj"ent will be "I already know how to do it!" The 
^cMre; . 'J'-t persevere and require that sentences be written in most cases 
because only in this way will the skill be learned and the student develop 

erJc i:' 
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the capabiVity to apply the skill in more complex situations. Attempts to 
translate difficult problems involving many conditions to open sentences with- 
out considerable practice on simple problems usually ends in failure. 

Second, teachers nust be aware that several differen' open sentences 
may equally v;ell rr.odel the sane verbal problem. In the example already de- 
scribed the sentence 1C80 - 9 could be used as a model quite appropriately. 
It's likely, hcv/ever, that many students will think of the problem i,ultinli- 
catively and './rite the sentence 9 X J= 1080. Either sentence is accc-niaf.e 
and both ^ead to a correct solution. Finally, make students aware trat or.y 
one open sentence r,y model a large number of situations that seem perceptially 
different but are alike structurally. 

Several other suggestions m,ay be of help. When this technique is 
being used as just a small segment of the lesson (e.g., 10 minutes) it will 
be desirable frequently to have students only write the open sentence that 
goes with a problem and not continue to find the exact solution. Also, for 
those students who have had little work with using open sentences in this vay 
it will be easier if the initial translations involve simple problem.s. Using 
problems from textbooks at lower grade levels is often a good idea under these 
circunstances . 
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Ei^hth-Orade Junicr High Teachers to the 
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Reactions ot "Non-rser" leachers to the Project 
4ie evaluation heets which tiie twelve teachers hroueiit to the initial 
project ipeetiHi! indicated extremelv favorable attitudes toward the program. 
\t least ei'^ht teac' ers ratevl every aspect ot the program except [)ace as 
either k;ood or vtrs good. The review and development pliases received th^ 
h-t;hest ratini;s. Altiiough increased pace was valued least, six teachers 
rated this part of the pro-ram as good or verv good. There was a good deal 
of similaritv between some aspects of the program and the methods teachers 
vere alread\ using m their c iassrooms . Da i 1 \ rev i ew ('el even t eacut^rs ) , 
developrrent (eleven), and teaching the class as a whole (ten) wer^ most 
often designated as having either great correspondence or general overlap 
witli teachniques teachers were already using. Mental coniput at i on , verh<il 
problem solving, and weekly review were used 1 ease often h\ teachers. 

Tables 2 and i indicate th<?t teachers were Tamil lar with all the verbal 
problem-solving strategies except problems without numbers. At least seven 
teachers reported using each verbal problem-solving strateg\ either t re- 
quentlv or occas i ona I 1 \ . V/ritmg an open sentence and estimating the answer 
were emp loved n.ost trequentlv. General strengths ot the program which were 
most often .rent I on ed were .^s buiit-m daily, weekly, and [iroad reviews 
ften teachers). Five teachers liked the lesson plan because class tune was 
^ell-btructurer! anri live te.i^hers also liked tlie verbal problem-solving 
-^lanuai. The weakest ispe'^t ot the program, as indicated D> seven teachers, 
vas that It '/as too re^iniented, did not contain enough variety, and might 
become boring tor stufients. Six teachers note 1 that the project required 
the.r. to do too much paperwork and recording o> scores. Five teachers thought 
ther- .v'ere ditticnlties with the program because of the a()-minute time limit 
V i^^ tiiev ^l^d »or eacb ^lass. It was ditMrult for theni tn work all ^ispecf; 
. , '-j-jr<jn. i-t'. e,i< h dry's lessn-.. fe t uers tliought that there were 
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'..-.•.■r.l .hinculnes and/or changes which needed to he made , p tiw l,o,„.>work 
phase: no.^ework should be started ,n class (although th>s procedure ^ part 
ot the program recommendation); the homework phase needs to be longer; and 
thev were concerned that pupils might cheat on homework assignments. In 
spite of these complaints, six teachers said thev would use the program 
It the modifications thev suggested were made, and tour teachers said that 
the\ would use parts ot the program. 

Reacti on of Partnership Teachers to the Project at the Initial Meet in^ 
The SIX project partnership teacher., who brought their evaluation 
sheets with them to the initial meeting also reported favorable attitudes 
toward the project. Three teachers said that the mental computation part 
ot the program was ver> good; two teachers rated the increased p^ce as verv 
good (although three teachers reported that the strategy was only so-so); 
tour ot the six teachers reported that the verbal problem-solving stage 
ot the lesson was verv good. According to these teachers, the weakest parts 
or the program were seatwork, homework, and increased pace (see Table 1). 

In genera!, teachers indicated that the basic training manual was com- 
parable to instructional methods they had been using. Seatwork and the broad 
,.nd veeklv reviews seemed to be newest to teachers. 'Ihe teachers reported 
that thev were tamil.ar with most (but not all) ot the verbal pr ob I en,-so U - 
mg strate.Mes. and that thfv were generally usmy the stratPi.,es, at least 
on occ j5 1 on . 

The tree responses teachers made to questions about th<- project mater- 
ials tollow the tables m this appendix and allow a detailed exarnnatio,. 
ot tH^rf,er concerns and suggestions. As can be seen, the non-.iser tearhers 
.ere -nch more thorough and expansive ,n their comments than were partner- 
,riip r^MChers. Hi-, ditterence is mentioned m the text ot the report. 
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yN?iiere 'vf fniphas i /ed that non-user teachers were much more verbal and ex- 
P'-ebsed M'icb ,-ore interest an<i -n^re positive aMect ibout tlie prcvram dur- 
ini; the 'iieettru, ctian did partnersfup teachers. 

In general » I li ie * mdicites tiiat l)Oth [partner and t reat ment tearhers 
were reisonai>lv supportive ot the pro^ran., although tfiere are diMereiices 
in support wit inn i^oth i.'roups. Ihere does not appear to he anv ovt-rall dit- 
tererice betweer p irtner md treitirent groups' attitudes toward the pro^^,ran!. 
.That is. there sj more diirterence withm than l)etween ';roup'S. 'Hi i s atfective 
r*^artio:i or te^^hers m j,eneral [>ara]lels the riip I einent at i op scores presen- 
te! earlier, Kid. help to explviin wIin there vere no ditterences in the 
etrects 01 partT'^'r andi treat^nent teachers. 
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Partnership Teachers' Pre- and Post-React i ons 
One interesting question concerns teachers* reactior^ to the project 
before the> had the opportunity to teach it and after the> liad used the 
program. As can be seen in Table 5, the partnership teachers' responses 
betore and after the project varied considerably, feacher 1 reported basic- 
ally the same reaction to the program as a whole and to each of the parts 
before and after the project. In the case of Teacher 2, all three changes 
m the rating were positive; and hence, the teacher became more supportive 
of the program* The responses of Teacher 3 are about balanced, but became 
slightly more negative after using the program. The same pattern is evi- ^ 
denced by leacher 4. In contrast, the changes for Teacher 5 were all in 
a positive direction and this teacher became much more supportive of the 
program. Teacher 6's ratings became more negative over time. Unfortunately, 
in the post-assessment forms, the rating of verbal probleiTi solving was 
inadvertently omitted, and comparisions cannot be made for this part ot 
the program. However, as we will see below, the teachers* tree respogg^ 
indicated a continuing interest m and support for verbal problem solving. 
On the tree responses, four of the six partnership teachers indicated that 
verbal problem solving was the most important part of the program. However, 
two of the general treatment teachers thought that this was the weakest 
part. Across all teachers, the only changes which appeared consistently 
were a tendency tor homework to increase in perceived va 1 up and tor pace to 
decrease iTv^value. 
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Initial Reactio-^s ot "Non-User" F i ^ht ii-Grade 
leachers (N 12) to the Missouri Mathematics 
E[ feet i veness Program 



Entire ProtiiraM- 
Rev lew 
De ve 1 opme^.t 
Seatwork 
Homework 
Mental Comp, 
Increaseii Pace 
Verbal I'rob. 



lable 1 


. C^eneral Reactions 


to the 


Project 


Verv 






1 Little 


No 


Good 




So-So 


j Value 


Va I ue 
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j t;ood 1 
; 10 i 
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1 1 
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Initial Reactions of "Non-User- Eighth-Grade 
Teachers (N . 12) to the Missouri Mat^iematics 
Effectiveness Program 



Table 2. Correspondence to Present Teach 



ing 



Whole Class 
Verbal Prob. 
Devel opmt . 
Seatwork 
Homework 
Mental Comp. 
Weekly Review 
Daily Review 



Great 


General 


Some 


Little 


Corresp . 


Overlap 


Overlap 


Overlap 


5 


5 


2 




1 


3 


6 1 


2 


7 




1 






2 


7 1 


1 




5 1 


2 1 


1 


1 

1 


^ 1 


5 1 


3 


^ 1 


3 1 


4 


3 1 


8 1 




1 
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Initial Reactions of "Non-User" Eighth-Grade 
Teachers (N ^ 12) to the Missouri Mathematics 
Effectiveness Program 



Table 3. Verbal Problem Solving 
Fam 1 1 1 ar it y 



Problems Without Nurbers 
Writing Verbal Problems 
Es:imating the Answer 
Reading Verbal Problems 
Writing Open Senten«'e 



Usage 



New 


Fami 1 iar 


Never 


1 Occas . 

1 


Freq . 


4 


8 


5 


1 

! 5 


2 




12 


1 


1 7 


4 




12 




i fc' 


6 


2 


10 


3 


! 5 


4 




12 

1 




1 3 


9 
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Initial Reactions of Partnership Eighth-Crade leach 
(N = 6) to the Missouri Mathematics 
Effectiveness Program 



Table 1. Reaction to the Project 



Entire Program 
Review 
Devel opment 
Seatwork 
Homework 
MentaiQftiap , 
Incr^sed Pace 
Verbal Prob* 



^^ery | 
Good 1 


Good 


So~So 


Little 
Val ue 


i No 
1 Value 


1 


5 


0 


0 


0 


1 1 


4 


' 1 


0 ' 1 
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1 1 


5 1 


0 


0 ^ 1 


0 


1 1 




2 


0 ' 1 


0 


1 1 


2 1 


3 1 


0 1 


0 


3 1 


3 1 


0 1 


0 1 


0 


2 1 


1 1 


3 1 


0 1 


t) 


4 1 


2 1 


0 i 


0 ] 
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Initial Reactions of Partnership K i gh t h-Grade Teachers 
(N h) to the Missouri Matlit^mat i cs 
hi t ect 1 veness I'rograin 



Table 2. Reaction to the Proiect 



Whole Class 
Verbal Prob. 
De ve I opment 
Seatwork 
Homework 
Mental Comp . 
Weekly Review 
Da 1 1 > Rev lew 



Great 


\ General 


Some 


Little 


Corresp . 




Over i ap 


Over 1 ap 


4 


j Overlap 

i 1 
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1 ^ 
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0 




1 < 
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1 1 
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1 ^ 
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' 1 
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Initial Reactior.^ Partnership Eighth-Grade Teachers 
b) to the Missouri Mathematics 
Effectiveness Program 



Table 3. Verbal Problem Solving 



Fami liarity 



Usa^e 



Problems W 1 1 houc Numbers 
Writm^^ Verbal Problems 
Estimating the Answer 
Reading Verbal Problems 
Writing Open Sentence 



New 


1 

1 Familiar 


1 Never 


1 

1 Occas, 


Freq. 


1 




1 1 
1 2 


t 

2 
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1 1 


■J 
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1 1 
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1 1 
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Part-^ership 


Teachers ' 


React ! ens 
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Program Be t ore 


and At I 
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Seatwork 
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3 (-) 
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2 (tM 
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2 ( O 


3 (-) 


Homework 
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2 (0) 




2 (0) 
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1 3 (-) 


Mental Computation 
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2 M) 1 
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1 1 (0) 
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3 ( - ) 
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1 (0) 


1 2 (-) 


Vac mg 
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1 (n) 
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A lower puniber indicates a more favorable attitude. 
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Reaction of Eighth Grade Teachers to the 
Missouri f'^ather^atics Effectiveness Program 



I . Reaction to the pr oject 

When responding to these questions, please use the following scale: 
1 = very good; 2 = good; 3 = so-so; 4 = of little value; 5 = of no 
value. 



/ my reaction to the 

/ my reaction to the 

/ my reaction to the 

my reaction to the 

/ my reaction to the 

/ my reaction to the 

my reaction to the 

my reaction to the 



entire program 
review phase of the lesson 
development stage of the lesson 
seatwork stage of the lesson 
hOTCwork stage of the lesson 
use of mental computation problems 
increased pace suggestion 
verbal problem solving material 



II. Correspondence to present teaching 

Please indicate which aspects of the program are already part of your 
classroom teaching. When responding please use the following scale: 

1 = great correspondence between what I was already doing and the 

program request. 

2 = general overlap between what I was already doing and the program 

request. 

3 = sone overlap between what I was already doing and the program request. 

4 = little if any overlap between what I was already doing and the pro- 
* gram request. 

/ teaching the class as a whole 
/ verbal problen solving strategies 
/ development 
J seatwork 
/ .homework 

^ mental computation 
3 broad review and v/eek'^y review 
daily review 



III. Verbal problem solving 

How different from your current practice are the five verbal problem 
solving strategies? When responding please use the following scales: 
Familiari ty Usage 

1 = new to me 1 = never use this strategy 

2 = familiar to me 2 = occasionally use this strategy 

3 = frequently use this strategy 

Famil iari ty Usage 



3 problems without numbers 

3 writing verb^afl problems 

^ estimating/xhe answer 

> 3 reading verbal problems 

^2z^ writing an open sentence 



Goneril ^eedbacl^ ^rc' lighth Grade Teachers about 
*/^o "i'-.s^jri y?t'>:iM:ics Effectiveness Progran. 



K General strenqt'^s. z 



/ 



\ 



2. General weaknesses. 



A- 



What changes need to be made to improve the program for secondary 
school application? 



In general, would you use the program (assuming the modifications you 
suggest in question # 3 are made)? 
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Reaction of Eighth Grade Teachers to the 
Missouri Mathematics Effectiveness Program 



I - Reaction to tire project 

When responding to these questions, please use the following scale; 
1 = very good; 2 = good; 3 = so-so; 4 = of little value; 5^ of no 



value 

^ my reaction to the entire program 

niy reaction to the review phase of the lesson 

^ my reaction to the development stage of the lesson 

3 my reaction to the seatwork stage of the lesson 

2, my reaction to the homework stage of the lesson 

my reaction to the use of mental computation problems 

my reaction to the increased pace suggestion 

my reaction to the verbal problem solving material 



ERIC 



I I . Correspondence t£ present te aching 

Please indicate v/hich aspects of the program are already part of your 
classroom teaching. When responding please use the following scale: 

1 = great correspondence between what I was already doing and tne 

program request. , , ^ . j 4., 

2 = general overlap between what I was already doing and the program 

r eouest 

3 = some overlap between what I was already doing and the program request 

4 = little if any overlap between what I was already doing and the pro- 
gram request. 

_J_ teaching the class as a whole 

verbal problem solving strategics 

^ development 

^ seatwork 
I .homework 
Q_ mental computation 
~\ broad review and weekly review 
daily review 

III. Verbal problem solvirig. 

How different from your current practice are the five verbal problem 
solving strategies? When responding please use the following scales: 
Fami liarity Usage _ 

= new to me 1 = never use this strategy 

2 = familiar to me 2 = occasionally use this strategy 

3 = frequently use this strategy 

Familiarity Usage 

X problems without numbers 

o" _2=_ writing verbal problems 

~1r ~£ estimating the answer 

"T" % reading verbal problems 

O l£ -3- writing an open sentence, 



General Feedback from Eighth Grade Teachers about 
the Missouri Mathematics Effectiveness Program 



General strengths. 



General weaknesses. ^ 
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3. What changes need to be made to improve the program for secondary 
school application? 

Jj^ Jia>o^ ■ ^^^^^^^ 

dt^ ^ ^ /Z^.^--^ 




4.*"*^ general , would you use the program (assuming the modifications you 
suggest in question # 3 are made)? 
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Reaction of Eighth Grade Teachers to the 
Missouri I^othen.atics Etfccti vcnoss Proorani 

I . Reaction to the project 

When responding to these questions, please use the fi]lo;ring scale: 

1 = very good; 2 = gcoa; 3 = so-so; 4 of little value; b = of no 
value . 

j). my reaction to the entire proqram 

ny reaction to the reviev/ phase of the lesson 

my reaction to t.he dovelop.Mcnt stage of the lesson 

my reaction to the seat\,'ork stage of the lesson 

^: my reaction to the hoinework staqe of the lesson 

i r.]y reaction to the use of mental coniputation prob'ienis 

/ my reaction to the increased pace suggestion 

my reaction to the verbal problem solving nateriai 

I I . Correspondence to pre sent teaching 

Please indicate which aspects of the program are already oart of your 
classroom teaching. When responding please use the follov/ing scale: 
1 = great correspondence between what; I was alreaJy doing and the 
program request. 

2'= general overlap between what I was already doing and the program 
request . 

3 = some overlap between wfiat I was already doing and the program requcs 

4 = little if any overlap between what I was already doing and the p.^o- 

gram request. 

|_ teaching the class as a whole 

Zi^ verbal Droblcn sol^Mng strategies 
devel oprient 

^ seatwork 

^ .homework 

1 mental computation 

Q broad review and weekly review 

J daily review 



III. V erbal probl en so1 v ing 

How different from your current practice are the five verbal problem 
solving strategies? When responding please use the following scales: 
Famil i ar ity Usage 

1 = new to me 1 - never use this strategy 

2 = familiar to me 2 = occasionally use this strategy 

3 = frequently use this strategy 

Fami lia rity Usage 

^ problems without numbers 

writing verbal problems 

' estimating the answer 

reading verbal problems 

J-' writing an open sentence 



General Feedback frcm Eighth Grade Teachers about 
the Missouri Mathematics Effectiveness Program 



General strengths. 




General weaknesses. 
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3. What changes need to be made to improve the program for secondary 
school application? 



4. In general, would you use the program (assuming the modifications you 
suggest in question # 3 are made)? 



er|c 
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Reaction of Eighth Grade Teachers to the 
Missouri Mathematics Effectiveness Program 



I . Reaction to thie project 

When responding to the:e questions, 
1 = very good; 2 = gc ^ ; 3 = so-so; 
value. 



please use the following scale: 
4 = of 1 ittle value; b = of no 



2^ my reaction to the entire program 

my reaction to the review phase of the lesson 
~^my reaction to the development stage of the lesson 
my reaction to the seat\^ork stage of the lesson 
, -> my reaction to the hoir.ework stage of the lesson 

my reaction to the use of mental computation problems 
~ my reaction to the increased pace suggestion 
~^ my reaction to the verbal problem solving material 



1 1 • Cor respond ence to present teaching 

Please indicate which aspects of the program are already part of your 
classroom teaching. When responding please use the following scale: 
1 = great correspondence between what I was already doing and .he 

genera"? overlap "between what I was already doing and the program 

3 = some'oJerlap between what I was already doing and the program request, 

4 = little if any overlap between what I was already doing and the pro- 
gram request. 



0 = 



teaching the class as a whole 
'2- verbal problem solving strategies 

development 
,y seatwork 
^7 .homework 

mental computation 

broad review and weekly review 

daily review 



III. Verbal probl em solving 

How different from your current practice are the five verbal problem 
solving strategies? When responding please use the following scales. 
Familiarity Usage 

■•pr^TTevrto me 1 = never use th^s strategy 

2 = familiar to me 2 = occasionally use this strategy 

3 = frequently use this strategy 
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Fa miliarit y 



Usage 



problems without numbers 
writing verbal problems 
estimating the answer 
reading verbal problems 
writing an open sentence 
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General Feedback from Eighth Grade Teachers about 
the Missouri Mathematics Effectiveness Program 



1. General strengths. 



2. General weaknesses. 
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What changes need to be made to improve the program for secondary 
school application? 



In general, would you use the program (assuming the modifications you 
suggest in question # 3 are made)? 



Partnership Teacher 



Rr^action of Eiglith Hrade Teochors to tfie 
Mibsoun KatiiC)':atics Lf fecti veness Prograni 

I. Re:-ction to the vro-od 



When rosf'-n.h'r: to :r^vj rjcstions, please u<^x V.^ ^ono-'in^] sccJe: 
1 = very ccor-, 2 - ocoJ; 3 = so-so; 4 - of little vaiue; b - of no 
value. 

ny reaction to the entire program 
_l_my reaction lo the review [)hase of the lesson 

^ reaction to tfie develcni:ent stage of the lesson 
^niy reaction to the seaf./ork stage of the lesson 
J_ ny reaction to the hci'^ehork stage of the lesson 

my reaction to tre use of mental conputation problenis 
, ^ ny reaction to the increased pace siinqestion 
f '-7 reaction to ^he verbal problem solving material 

Corre$pof^d'}}ice_ to }:r_^^s_Pivt teaching 

Please indicate \;hich aspects of the prograni are already part of your 
classroom teacliii/j. l.'rcn responding please use the ^ollowinn scale: 

1 = great corrcsrendence uetween what 1 \^as already doing and the 

program re^]uc.st. 

2 = general over-up Lctivoen what I was already doing and the program 

request. 

3 = sone overlap between what I was already doing and the program request, 

4 = little if any overlap between what I was already doing and the pro- 

gram request. 

3 teaching the class as a \/holc 

^ verbal ureblei solniig strategies 

2 devel onf-^ent 

3 seat\/ork 
0 .homework 

mental co:',putation 
^ b^•oad revic.; and weekly review 
3 daily review 



r current practice are the five verbal problem 
hen responding please use the following scales: 

Us_a2C 

T= never use this strategy 

2 - occasionally use this strategy 

3 = frequently use this strategy 



probleii.s without numbers 
writing verbal problems 
estimating the answer 
reading verbal problems 
writing an open sentence 

*^ ^ 



III. Verbal probien sol_vj nj] 

Hov/ different from you 
solving strategies? M 
Fa mil i_a_ritv 
T = nev/ to re 
? - famil iar to me 



1^ Jj 
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General Feedback from Eighth Grade Teachers about 
the Missouri Mathematics Effectiveness Program 
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1. General strengths. 



2. General weaknesses. ^ 

ex...c. e...P.. ^-"'^ ^1";, . 

ftp eve«V<«v( ^'^^ ' 

af-f" C 
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. What changes need to be made to improve the program for secondary 
school application? 



In general, would you use the program (assuming the modifications you 
suggest in question # 3 are made)? 



Partnership Teacher 
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Reaction of Eighth Grade Teachers to the 
Missouri Mathematics Effectiveness Program 



I . Reaction to the_ p roject 

When responding to these questions, please use the following scale: 
1 = very good; 2 = good; 3 = so-so; 4 = of little value; 5 = of no 
value. 



my 
my 
my 
my 
my 
my 
my 
my 



reaction to the entire program 
reaction to the review phase of the lesson 
reaction to the development stage of the lesson 
reaction to the seatwork stage of the lesson 
reaction to the homework stage of the lesson 
reaction to the use of mental computation problenis 
reaction to the increased pace suggestion 
reaction to the verbal problem solving material 



1 1 . Correspo ndence t£ present teaching 

Please indicate which aspects of the program are already part of your 
classroom teaching. When responaing please use the following scale: 

1 great correspondence between what I was already doing and the 
program request. 

2 = general overlap between what I was already doing and the program 

request. 

3 = some overlap between what I was already doing and the program request. 

4 = little if any overlap between what I was already doing and the pro- 

gram request. 

/ teaching the class as a whol? 

verbal problem solving strategies 
y development 
/ seatwork 

^.homework 

( mental computation 
3 broad review and weekly revi^jw 
/ daily review 



III. V erbal problem sol ving 

How different from your current practice are the five verbal problem 
solving strategies? When responding please use the following scales: 
F amiliarity ' Usage ' 

1 = new to me T = never use this strategy 

2 = familiar to me 2 = occasionally use this strategy 

3 ^ frequently use this strategy 



Famil iarity Usage 



problems without numbers 
writing verbal problems 
estimating the answer 
reading verbal problems 
writing an open sentence 



General Teedback from Eighth Grade Teachers about 
the Missouri Mathematics Effectiveness Program 



General strengths. 



Genera! weaknesses. 



What changes need to be made to improve the program for secondary 
school application? 



In general, would you use the program (assuming the modifications you 
suggest in question # 3 are made)? 
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Initial Reaction of Eighth-Grade j 
"Non-User" Teachers 
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Reaction of Eighth Grade Teachers to the 
Missouri Mathematics Effectiveness Program 



Reaction to the project 

When responding to tfVese questions, please use the following scale: 
1 = very good; 2 = good; 3 = so-so; 4 = of little value; 5 = of no 
value. 

the entire program 
the review phase of the lesson 
the development stage of the lesson 
the seatwork stage of the lesson 
the homework stage of the lesson 
the use of mental computation problems 
the Increased pace suggestion 
the verbal problem solving material ' 



Correspondence to^ present te aching 

Please indicate wh^ich aspects of the program are already part of your 
classroom reaching. When responding please use the following scale: 

1 = great correspondence between what I was already doing and the 

program request. 

2 = general overlap between what I was already doing and the program 

request. 

3 ='some overlap between what I was already doing and the program request 

4 = little if any overlap between what I was already doing and the pro- 

gram request. 

* 

_l_teachia5 the class as a whole 
_L verbal problem solving strategies 

l_ development 

l_ seatwork y 

^ homework 

^ mental computation » 

broad review and weekly review 

daily review 



Verbal problem sol ving 

How different from your current practice are the five verbal problem 
solving strategies? When responding please use the following scales; 
Famil.tarity ^ ' Usaje 

1 = new to me T~= never use this strategy 

2 = familiar to me 2 = occasionally use this strategy 

3 = frequently use this strategy 



problems without numbers 
writing verbal problems 
estimating the answer 
reading verbal pn 
writing an open sentence 



/ my reaction to 

J my reaction to 

my reaction to 

my reaction to 

^my reaction to 

^ my reaction to 

my reaction to 

my reaction to 



Famil iarity Usage 
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Reaction of Eighth Grade Teachers to the 
Missouri Mathematics Effectiveness Program 



I. Reaction to the project 

When responding to these questions, please use the following scale- 
1 = very good; 2 = good; 3 = so-su; 4 = of little value; 5 = of no 
value. 

my reaction to the entire program 
^ J_ my reaction to the review phase of the lesson 
.1 my reaction to the development stage of the lesson 

my reaction to the seatwork stage of the lesson 

reaction to the homework stage of the lesson 

reaction to the use of mental computation problems 

._L. reaction to the increased pace suggestion 

^y reaction to the verbal problem solving material 

I I . Correspondence to present teaching 

Please indicate which aspects of the program are already part of your 
classroom teaching. When responding please use the following scale: 

1 = great correspondence between what I was already doing and the 

program request. 

2 = general o/erlap between what I was already doing and the program 

reqjjest. 

3 = some overli^p between what I was already doing and the program request. 

4 = little if any overlap between what: I was already doing and the pro- 
^ gram request. ^ 

I teaching the class as a whole 

verbal problem solving strategies 
I developn^em: 
^ _ seatwork 
homp.work 

mental computation 

_ ;/ broad review and weekly review 
^ daily review 

III. Verbal pre hi em solving 

How different from your current practice are the five verbal problem 
solving strategies? When responding please use the following scales: 

Famil iarity Usage 
^ 1 = new to me 1 = never use tfiis strategy 

2 = familiar to me 2 = occasionally use this strategy 

3 = frequently use this strategy 



Famil fari ty Usag e 
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problems without numbers 
writing verbal problems 
estimating the answer 
reading verbal problems 
writii'g an open sentence 



"Non-user" Responses to the Project 
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Reaction of Eighth Grade Teachers to the 
Missouri Mathematics Effectiveness Program 



I. Reaction to the project 

When responding ro these questions, please use the following scale: 
1 = very good; 2 = good; 3 = so-so; 4 = of little value; 5 = of no 
value. 



^ my reaction to the entire program 

the review phase of the lesson 
the development stage of the lesson 
the seatwo»*k stage of the lesson 
the homework stage of the lesson 
the use of mental computation problems 
the increased pace suggestion 
my reaction to the verbal problem solving material 



X. niy reaction to 

my reaction to 

my reaction to 

my reaction to 

my reaction to 

n^y rea«' t» fta<j^o 



I I . Correspondence to present teaching 

Please indicate which aspects of the program are already part of your 
r'^assroom teaching. When responding please use the following scale: 

1 ^ great correspondence between what I was already doing and the 

program request. 

2 = general overlap between what I was already doing and the program 

request. 

3 = some overlap between what I v;as already doing and the program request. 

4 = little if any overlap between what I was already doing and the pro- 

gram request. 

a teach-ing the class as a whole 
21 verbal problem solving strategies 
development 
seatwork 
_ homework 
3 ^ mental computation 
^ broad review and weekly review 
^ daily review 

»^ 

III- Verbal problem solving 

How different from your current practice are the five verbal problem 
solving strategies? When responding please use the following scales: 
Familiarity Usage 

1 = new to me 1 = never use this strategy 

2 =^ familiar to me 2 =^ occasionally use this strategy 

3 = frequently use this st][ategy 

7 

Familia rity Usage 

problems without numbers 

Oj^ writing verbal problems 
^ estimating the answer 

I reading verbal problems 

^ writing an open sentence 
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Reaction of Eighth Grade Teachers to the 
Missouri Mathematics Effectiveness Program 



Reaction to the project 

When responding to these questions, please use the following scale- 
1 = very good; 2 = good; 3 = so-so; 4 = of little value; 5 = of no 
value. 

my reaction to the entire program 
_/_my reaction to the review phase of the lesson 

my reaction to the development stage of the lesson 

my reaction to the seatwork stage of the lesson 

my reaction to the homework stage of the lesson 

my reaction to the use of mental computation problems 

my reaction to the increased pace suggestion 

my reaction to the verbal problem solving material 



Correspondence to present teaching 

Please indicate which aspects of the program are already part of your 
classroom teaching. When responding please use the following scale: 

1 - great correspondence between what I was already doing and the 

program request. 

2 = general overlap between what I was already doing and the program 

request. 

3 = some overlap between what I was already doing and the program request, 

4 = little if any overlap between what I was already doing and the pro- 

gram request. 

^' teaching the class as a whole 
^\ verbal problem solving strategies 

development 
H seatwork 
^ homework 
H mental computation 
2^ broad review and weekly review 
7 daily review 



Verbal proble m solving 

How different from your current practice are the five verbal problem 
solving strategies? When responding please use the following scales: 
Familiarity Usage 

1 = new to me 1 = never use this strategy 

2 = familiar to me 2 = occasionally use this strategy 

3 = frequently use this strategy 



problems without numbers 
writing verbal problems 
estimating the answer 
reading verbal problems 
writing an open sentence 



Famil iarity 



Usage 



7 
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Reaction of Eighth Grade Teachers to the 
Missouri Mathematics Effectiveness Program 



I . Reaction to the^ project 

When responding to these questions, please use the following scale: 
1 = very good; 2 = good; 3 = so-so; 4 = of little value; 5 = of no 
value. 



^ my 
"T" my 
7 my 
3 my 



^ my 

J my 
3 my 

my 



reaction to the entire program 
reaction to the review phase of the lesson 
reaction to the development stage of the lesson 
reaction to the seatwork stage of the lesson 
reaction to the homework stage of the lesson 
reaction to the use of mental computation problems 
reaction to the increased pace suggestion 
reaction to the verbal problem solving material 



1 1 . Correspondence to^ prese nt teaching 

Please indicate which aspects of the program are already part of your 
classroom teaching. When responding please use the following scale: 

1 = great correspondence between what I was already doing and the 

program request. 

2 = general overlap between wfiat I was already doing and the program 

request . 

3 = some overlap between w.Kd I was already doing and the program request. 

4 = little if any overlap between what I was already doing and the pro- 

gram request. 

jf teaching the class as a whole 

7 verbal problem solving strategies 

3 development 

3 sea two rk 

J homev/ork 

^ mental computation 

3 broad review and weekly review 

/ daily review 



III. Verbal problem sol v ing 

How different from your current practice are the five verbal problem 
solving strategies? When responding please use the following scales: 
Fam iliar ity Usage 

new to me 1 = never use this strategy 

2 ^ familiar to me 2 = occasionally use this strategy 

3 = frequently use this strategy 



Familiarity Usage 
^ ) problems without numbers 

^ a. writing verbal problems 

^ "aT estimating the answer 

reading verbal problems 




^ writing an open sentence 
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Reaction of Eighth Grade Teachers to the 
Missouri Mathematics Effectiveness Program 



I . Reaction toi the^ project 



When responding to these questions, please use the following scale: 
1 = very good; 2 = good; 3 = so-so; 4 = of little value; 5 = of no 
value. 



tfL my reaction to the 

^ my reaction to the 

mv reaction to the 

/^-ajL "^y reaction to the 

my reaction to the 

my reaction to the 

_ my reaction to the 

_ 3 my reaction to the 



entire program 
review phase of the lesson 
development stage of the lesson 
seatwork stage of the leszjn 
homework stage of the lesson 
use of mental computation problems 
increased pace suggestion 
verbal problem solving material 



1 1 . C orrespondence to present teaching 

Please indicate which aspects of the program are already part of your 
classroom teaching. When responding please use the following scale: 

1 = great correspondence between what I was already doing and the 

program request. 

2 ' general overlap between what I was already doing and the program 

request. 

3 = some overlap between what I was already doing and the program request. 

4 = little if any overlap between what I was already doing and the pro- 

gram request. 

teaching the class as a whole 
y verbal problem solving strategies 
development 
seatwork 
^ homework 
JL^ mental computation 
JL^ brodd review and weekly review 
JSL^aily review 




III. Verbal problem sol ving 
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How different from your current practice are the five verbal problem 
solving strategies? When responding please use the following scales: 

Usage 

1 = never use this strategy 

2 = occasionally use this strategy 

3 = frequently use this strategy 



Famil iarity 

1 = new to ne 

2 = famil iar to me 



Famil iarity 

n — 

A. 

a. 




problems without numbers 
writing verbal problems 
estimating the answer 
reading verbal problems 
writing an open sentence 
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Reaction of Eighth Grade Teachers to the 
Missouri Mathematics Effectiveness Program 



I . Reaction to^ the pro ject 

When responding to these questions, please use the following scale: 
1 = very good^Z = good; 3 = so-so; 4 = of little value; 5 = of no 
value. 



the entire program 
the review phase of the lesson 
the development stage of the lesson 
the seatwork stage of the lesson 
the homework stage of the lesson 
the use of mental computation problems 
the increased pace suggestion 



A my reaction to 
my reaction to 
^ j m reaction to 
^ . my reaction to 
J^^m reaction to 
my reaction to 
^ my reaction to 

"7^ my reaction to the verbal problem solving material 



I I . Correspondence t£ present teaching 

Please indicate which aspects of the program are already part of your 
classroom teaching. When responding please use the following scale: 

1 = great correspondence between what I v/as already doing and the 

program request. 

2 = general overlap between what I was already doing and the program 

request. ^ 

3 = some overlap between what I was already doing and the program request. 

4 = little if any overlap between what I was already doing and the pro- 

gram request. 

teaching the class as a whole 




verbal problem solving strategies 
development 



^ seatwork 
^ homework 
3 mental computation 

broad reviev/ and weekly review 
daily review 




III. Verbal problei i sol ving 

How different from your current practice are the five verbal problem 
solving strategies? When responding please use the following scales: 
Familiari ty Usaje 

1 = new to'~r,e 1 = never use this strategy 

2 = familiar to me 2 = occasionally use this strategy 

3 = frequently use this strategy 
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Fam iliarit y Usage 

3 problems without numbers 
writing verbal problems 
3P estimating the answer 
J reading verbal problems 
5' writing an open sentence 
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Reaction of Eighth Grade Teachers to the 
Missouri Mathematics Effectiveness Program 



I. Reaction to the project 

When responding to these questions, please use the following scale: 

1 = very good; 2 = good; 3 = so-so; 4 = of little value; 5 = of no* 
value. 

^ niy reaction to the entire program 

/ my reaction to the review phase of the lesson 

_i_n\y reaction to the development stage of the lesson 

my reaction to the seatwork stage of the lesson 

my reaction to the homework stage of the lesson 

my reaction to the use of mental computation problems 

^ niy reaction to the increased pace suggestion 

^ my reaction to the verbal problem solving material 



1 1 . Correspondence t o^ present teaching 

Please indicate which aspects of the program are already part of your 
classroom teaching. When responding please use the following scale: 

1 = great correspondence between what I was already doing and the 

program request. 

2 = general overlap between what I was already doing and the program 

request . 

3 = some overlap between what I was already doing and the program request. 

4 = little if any overlap between what I was already doing and the pro- 

gram request. 

teaching the class as a whole 
? verbal probleni solving strategies 
/ development 
J seatwork 
/ homework 
JL mental computation 

^ broad review and weekly review 

^ daily review 
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III. Verbal problem solving 

How different from your current practice are the five verbal problem 
solving strategies? When responding please use the following scales; 
Famil iari ty Usage 

1 = new to me 1 = never use this strategy 

2 = familiar to me 2 = occasionally use this strategy 

3 = frequently use this strategy 

Fami 1 iarit y Usage 

^ problems without numbers 
"2 9 writing verbal problems 

estimating the answer o , ^ 

^ D reading verbal problems ^-.y' 

O , % :^ writing an open sentence 
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Reaction of Eighth Grade Teachers to the 
Missouri Mathematics Effectiveness Program 



I . R eaction t£ the_ project 

When responding to these questions, please use the following scale: 
1 = very good; 2 = good; 3 = so-so; 4 = of little value; 5 = of no 
value. 



^ my reaction to the 

my reaction to the 

my reaction to the 

my reaction to the 

l_ my reaction to the 

my reaction to the 

3 " my reaction to the 

my reaction to the 



entire program 
review phase of the lesson 
development stage of the lesson 
seatwork stage cf the lesson 
homework stage of the lesson 
use of mental computation problems 
increased pace suggestion 
verbal problem solving material 



I I . Correspondence to present teaching 

Please indicate which aspects of the program are already part of your 
classroom teaching. When responding please use the following scale: 

1 = great correspondence between what I was already doing and the 

2 = general" oveHap* between what I was already doing and the program 

3 = soSro'verlap between what I was already doing and the prograin request. 

4 = little if any overlap between what I was already doing and the pro- 

gram request. 

/ teaching the class as a whole 
^verbal problen soUing strategies 
^ development 
j seatwork 
homework 
g nental computation 

broad review and weekly review 
/ daily review 



III- Verbal probl em solving 

HOW different from your current practice are ^^^^J^^. J?;;^^; P^?^^^^ 
solving strategies? When responding please use the following scales. 
Famil iarity Usage 

T~= new to T^never use this strategy 

2 - familiar to me 2 = occasionally use this strategy 

3 = frequently use this strategy 

Famijj^rit^'_ Usage 
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problems without numbers 

V J writing verbal problenis ^ ,^ T/ > 

estinatinq the answer ' " ' j'jif,^ 

reading verbal problems 



writing an open sentence 



"Non-user" Responses to the Project 



Reaction of Eighth Grade Teachers to the 
Missouri Mathematics Effectiveness Program 

Reaction to the project 

T"\lT,ltlV- TnT,' r''''''^ ^°11-ing scale: 

value ^ " ^ ^ ^ = °^ ^^'"le value; 5 = of no 

_:^my reaction to the entire program 
' reaction to the review okSse of the lesson 

rlTctlZ In It^ de^flopfent stage of the lesson 
rTrliJ I lu^ seatwork stage of the lesson 
react on to the homework stage of the lesson 

tZ rTtZ In l^' °' "T''' ^-P^tation ?oblems 
/ my react on to the increased pace suggestion 



my 
my 
my 
my 
my 
my 



_^ my reaction to the verbal problem solving material 
I- Correspondence toi jTrP^Prvf^ jg^rhinj^ 



" pr"gJam°r^:S°?'"" '''' ' ''''''' ^-""^ 

?eSuesJ.°'''^'' ^ '^'^'^y d°^'"9 the program 



3 
4 



- ???nr?i;\'^ ^'^^'T "!!'^ ^ ^^'-^^dy doing and the program request 
" gJam^reques?' ''''''' '''' ' ''^'''y doing'an? ?Se p?"!''' 



^ teaching the class as a whole 
^verbal problem solving strategies 

L development 

t seatwork 

i homework 

^ mental computation 

L broad review and weekly review 

L daily review 



Verbal problem solving 

How different from your current practice are the five verbal Droblpm 

1 : ;ew to me r^ever use this strategy 

2 - familiar to me 2 = occasionally use this strategy 

3 « frequently use this strategy 

Familiarity Usage 

problems without numbers 
^ writing verbal problems 

±^ estimating the answer 
^ reading verbal problems 
writing an open sentence 



"Non-user" Responses to the Project 

224 

Reaction of Eighth Grade Teachers to the 
Missouri Mathematics Effectiveness Program 



I . Reaction to the project 

When responding to these questions, olease use the following scale: 
1 = very good; 2 = good; 3 = so-so; 4 = of little value; 5 = of no 
value. 

3L my reaction to the entire nrogr^^ 

X my reaction to the review phase of the lesson 

my reaction to the development stage of the lesson ^ 

1 my reaction to the seatwork stage of the lesson 

my reaction to the homework stage of the lesson 

my reaction to the use of mental computation problems 

my reaction to the increased pace suggestion 

ji my reaction to the verbal problem solving material 



II. Correspondence to present teaching 

Please indicate v/hich aspects of the program are already part of your 
classroom teaching. When responding please use the following scale: 

1 = great correspondence between what I was already doing and the 

program request. 

2 = general overlap between what I was already doing and the program 

request. 

3 = some overlap between what I was already doing and the program request. 

4 = little if any overlap between what I was already doing and the pro- 

gram request. 

I teaching the class as a whole 

verbal problem solving strategies 
I development 
X seatwork 
X homework 
H mental computation 

broad review and weekly review 
X daily review 



III. Verbal problem solving 

How different from your current practice are the five verbal problem 
solving strategies? When responding please use the following scales: 
Familiarity Usage 

1 = new to' me T '= never use this strategy 

2 = familiar to me 2 = occasionally use this strategy 

3 = frequently use this strategy 



Fa miliarity Usage 
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_ _ problems without numbers 

2^ writing verba! problems 

^ 3^ estimating the answer 

31^ a, reading verbal problems 

^ 3_ writing an open sentence 
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Reaction of Eighth Grade Teachers to the 
Missouri Mathematics Effectiveness Program 

I . Reaction to the project 

When responding to these questions, please use the following scale- 

1 = very good; 2 = good; 3 = so-so; 4 = of little value; 5 = of no 
value. 

^ my reaction to the entire program 

^my reaction to the review phase of the lesson 

^my reaction to the development stage of the lesson 

l^y reaction to the seatv/ork stage of the lesson 



±_ my reaction to the homework stage of the lesson 
jL^y reaction to the use of mental computation problems 



_^my reaction to the increased pace suggestion 
2l my reaction to the verbal problem solving material 



II. Correspondence to present teaching 

Please indicate which aspects of the program are already part of your 
classroon teaching. When responding please use the following scale: 

1 = great correncondence between what I was already doing and the 

program request. 

2 ^ general overlap betv;een what I was already doing and the program 

request. 

3 ^ some overlap between what I was already doing and the program request. 

4 - little if any overlap between what I w^is already doing and tne pro- 

gram request. 

^ teaching the class as a whole 
verbal problem solving strategies 
development 

3 seatwork 

^ homework 

mental computation 

Abroad review and weekly review 
I daily review 
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ill. Verbal proble m solving 

How different from your current practice are the five verbal problem 
solving strategies? When responding please use the following scales: 
Famil iarity Usage 

1 = new to me 1 = never use this strategy 

2 = familiar to me 2 = occasionally use this strategy 

3 = frequently use this strategy 

Fanil iarity Usage 

A problems without numbers 
Jl. ^ writing verbal problems 

t estimating the answer ^; 

reading verbal problems 
3 writing an open sentence 
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General Feedback from Eighth Grade Teachers about 
the Missouri Mathematics Effectiveness Program 

1. General strengths. 

I i ^ ro hi f ^ , 



2. General weaknesses. , /^Aiyir'-' ^ 7^^' ' 
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What changes need to be made to improve the program for secondary 
school application? 

Q Srn^ wo.^ jA,. c^r./r.V 



/ /^/ r h t crT ^ . 



In general, would you use the program (assuming the modifications you 
suggest in question # 3 are made)? 



To Q C z--'*'^ rriri'T 



"Nonriiser" Responses to the Project ^ ' -228 

General Feedback from Eighth Grade Teachers about 
the Missouri Mathematics Effectiveness Program 

^.1 General strengths. - , . ^^i,.^ .Sjtr.-^^ ■-^'-^^ 



2. General v/eaknesses. . - ^ cL^^^^^^^^^^^^ 

V 

? 
\ 




^2 

3. What changes need to be made to improve the program for secondary 
school application? 



4. In general, would you use the p>-ogram (assuming the modifications you 
suggest in question # 3 are made)? 
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General Feedback from Eighth Grade Teachers about 
the Missouri Mathematics Effectiveness Program 



1 H) C 



1. General strengths. ^ ^ 



2. General weaknesses. 
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3. What changes need to be made to improve the program for secondary 



In general, would you use the program (assuming the modifications you 
suggest in question § 3 are made)? 



.0 
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General Feedback from Eighth Grade Teachers about 
the Missouri Mathematics Effectiveness Program 



1. General strengths. 



, , ' ■ ^ hut if^" 



,,.ix^ tirx^ ^^■'^^ -l'^,^ , ■ ^C,/ ' , u^.- / 



2. General weaknesses. //.^ /c ^'<^' - ^^^ ^ 



er|c 
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3. What changes need to be made to improve the program for secondary 
school application? 

yr^l^^rv^ U>ALjJi'-<tk 4JjjMkU4.vj fU ?^/:, .rj"^ 

4. In general, would you use the program (assuming the modifications you 
suggest in question # 3 are made)? 

j^Ajdb JJ^t l^tJL JUMX^ /myrx./^.. xj 



■J 



-user" Responses to the Project 

Genera) F^^edback from Eighth Grade Teachers about 
the Missouri Mathenatics Effectiveness Program 



General strengths, ^ yy JUL . -J 



General weaknesses. — y7 . /^^j 



3. What changes need to be made to improve the program for secondary 
school application? 
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4, In general, would you use the program (assuming the modifications you 
suggest in question ^ 3 are made)? 

.<u..^ ^uJ.^ A^--^ . 
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"Non-user" Responses to the Project 



General Feedback from Eighth Grade Teachers about 
the Missouri Mathematics Effectiveness Program 



1 . General 



strengths. ^^/(, , ^r>^ 
2. General v/eaknesses. 
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3, What changes need to be made to improve the program for secondary 
school application? 




4, In general, would you use the program (assuming the modifications you 
suggest in question # 3 are made)? 



er|c 
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General Feedback from Eighth Grade Teachers about 
the Missouri Mathematics Effectiveness Program 

1. General strengths. . ^ A <" ■ 



2, General weaknesses, ^..^^^^.^ . ^ 
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3. What changes need to be made to improve the program for secondary 
school application? ^ 

' :tr^ 3<^^ X ^"-^ 

4. In general /would you use the program [assuming the modifications you 
suggest in question # 3 are made)? ^ J / ^ 

^;;;7r '-"'i^ ^ ^ ^^w. 





^14 

/ 
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General Feedback from Eighth Grade Teachers about 
the Missouri Mathematics Effectiveness Program 



1. General strengths. i 
vaUl. (UILll / 

I 

I 



) 

2. General weaknesses. 



CW^in^ Jux>iL^ ^^^^i^-^ ^ ^^^^f m^^^'-^^- 

a) • / 



3. What changes need to be made to improve the program for secondary 
school application? 
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4. In general, would you use the program (assuming the modifications you 
suggest in question # 3 are made)? 
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General Feedback from Eighth Grade Teachers about 
the Missouri Mathematics Effectiveness Program 



1. General strengths. 



2. General weaknesses. 

•Ki; s^.vv^ Y^^.'^^s ^'-C Xc. r>vc orcifr '^voj d^«j, pc/K^p^ r/. 

\ ciass S/ze^. 



t A, t/ 



(oi I gArf once o u^h^ U.^, , ^ 



243 



ERIC 



3. What changes need to be made to improve the program for secondary 
school application? 



4. In general, would you use the program (assuming the modifications you 
suggest in question § 3 are made)? 



— ^ J 



user" Response? to the Project 



General Feedback from Eighth Grade Teachers about 
the Missouri Mathematics Effectiveness Program 



General strengths. 



General weaknesses. 



h I 



I 



'■'1 - ' '■ W/ ' ' 
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What changes need to be made to Improve the program for secondary 
school application? . ^ ^ ^ /;y 



r 




In general, would you use the prograin (assuming the modifications you 
suggest in question # 3 are made}? 



"Non-user" Responses to the Project ^ ,4^ 

General Feedback from Eighth Grade Teachers about 
the Missouri Mathematics Effectiveness Program 

1. General strengths. 



c) iit.vvv-; c ^uJM^j f^^^-f^ ^':}Tt^\ 




2. General weaknesses. , , , . f I Jj \ 
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3. What changes need to be made to improve the program for seconda 
school application? 
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4. In general, would you use the program (assuming the modifications you 
suggest in question # 3 are made)? tA//j 

0 



248 



Appendix 6 



Interview Responses of All 
Partnersiiip Teachers and Some Treatment Teachers 
to the Mathematics Project^ 



• 4 



'ihese date ^-»re dr.iwn t rom ir.terviews conductiid bv L)r. Dee Ann Spencer-Hall 
after the project w;is terminated. For a discussion ot these data, see paRcs 
'^.7 to 40 m the t^^xt. Note that m order to mask the identity of mdivi- 
d"!qi te.ichers, all t^.ichers .^re referred to as "she" m interview (iescrip- 
tions .ijr'.o'J>[h .ViO'it hilt ot the te-ichers were males. Much ot the rich dt-- 
scr'pttOT. IS lost .')HC ^use statemeiits dHScribm^ a unique practice or set- 
ting Afere oniittefl a M' to '=iask the identitv of respondents. 

ERIC 
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learher 01 (Partnership Interview) 

Math Program , readier 1 didn't think she had participated much in the 
project. She was "too old to learn new ways." Her main criticism was that 
It was too continiak! and inflexible. She didn't think the text allowed 20 
minutes ot development and preferred the old Laidlaw book because it had 
more ^uepth. " 

Researchers . 1 can only describe Teacher Ts reaction to participation in 
the program as ver\ resentful. She felt that she was forced from the begin-- 
nin>^, that it was a "iiurry-up deal,*' and that the principal coerced teach- 
ers to participate at the last minute. She compared it to an enjoyable 
science project she participated in a tew years ago. The science program 
had more meetings, the leader was relaxed about it and teachers participa- 
ted m the planning. Teacher 1 felt that in the present study the research- 
ers said it must be done this way, and that because there was only one 
brief meeting, teachers had no real input. She was upset about the lack of 
feedback and interaction with the observers. Her students also would have 
liked feedback. 



2 50 

Teacher 02 ( l'arti\ersh i p Interview) 

Math PrORram . Teacher 2 was verv positive about the program. She tried to 
lollow the schedule exactU. Her implementation went slowly at first, but 
gradual!) smoothed out. She telt the program was so effective that she will 
use It from now on. She had some good specific suggestions ror change, she 
thought there ^as a need to develop the area of estimating, to "beef it 
up." It took her too long to lay the groundwork for estimation to the point 
where students could do it. She combined the mental estin.ation and the word 
problems and sa.d she would suggest that the review also be combined with 

mental est i.nat i ons . 

She telt a -weakness was that it took so long 'two weeks i to smooth 
out the routine. In eeneral, it was harder to use the pro|am with lower 
classes i.e., slower classes require more time, both for development and 
for discipline, which ..srupts the routine). However, this teacher stated 
that bv gomt: .r.ore s 1 ow m all classes and also by expanding into n.ore 
areas, that the slo^.er clisses could feel the^ were keeping up lor a chan . 

Teacher 2 di'l n ent i on thit tlie ■nental computation was particularU 
400d and that her students lo.,ed ,t. In retrospect, she feels that she 
,:i l-r ^o as rar in the book as she woulu have norma 1 K , but because she 
d.: so .Mien de.elopn.ent m .ore areas, in the 1 on^ r,.n, students will have 
covered as T.urh .terial as thes normally would have bv the end ol the year. 

:r taUir^ t otb-r t-achers, she said there were mixed react I'^n;, to 
partiCH'-tm. in f.p project, i.e., some liked it, some didn't, an-l some 

..re the nid-Ilp. be thought tt.ese reactions resulted from the tact ihit 
evervon; wants to teich tilings his/her own wqy. 

Kesearcners. leacher . had little neizative reaction, hut said she was a 
■•r r. srr.te', it ' ^ r -r her .use ,Se vis reluctai.r to^ritici/e the 
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pro^rdfti becmse she had never used it before. Teacher 2 decided she would 
tr\ the program tirst and then discuss her reaction (as in the interview). 
She thought it would improve projects where teachers and professors work 
together if professors got back into the classroom (to teach). She telt 
professors need more realistic input rather than learning things second- 
hand from teachers. 

She was worried that her students didn't understand why observers were 
m the classroom. Students were bothered, as was Teacher 2. She was also 
curious about researchers' conclusions and was not aware that she would be 
kiettmg any feedback on the results. 
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Teacher 03 (Partnership Interview) 

Math Program , Teacher 3 had a mixed reaction to the program. She was using 
the techniques m the program already, but thought the schedule was too 
rigid. She was primarily critical ot not grading homework. Teacher 3 spent 
a lot of time givm^^ me a detailed explanation about wny and how she graded 
homework. She was positive about the word problems and the idea of reading 
them without numbers. This teacher will change to the extent that slie will 
incorporate this style ot teaching word problems. 

Researchers » Teacher 3 had no problem with tlie early meetings, but felt 
sel t-consc lous when she was observed, because she didn't think she'd really 
done htr part. Her students ^ere curious about the observers and explained 
to the students that thev were part of a large number of participants and 
would just be statistics, not indi ''iduals . Teacher 1 predicted that her 
students would do no better on the post-test than on the pre-test; there- 
fort, she hoped it v^s "worth all the nione\ they spent." In summar> , she 
said she didn't participating, but on the other hand, it was a bother. 

\nTF : This teacher v^s omitted from the sample because she failed to 

implement the program, '[he correspondence between verbal and actual 
behavior is not alwavs higli' ^>ee also the description ol the two 
o'^ser.'^^rs ot f is teacher in Appendix f", . 
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Teacher 04 (Partnership Interview) 

Math Program . Teacher 4 thought the math program was exactly what she did 
m her classes already. In fact, she added that she wouldn't have agi d to 
participate if the methods hadn't been so similar to what she did. 

She said the strong point was in the area of problem solving and men- 
tal computation. The weak point was the idea of having both a daily assign- 
ment and homework — this puts too much paperwork on the teacher. She had no 
suggestions for change. 

Researchers . Teacher 4 felt the meetings last fall were quite beneficial 
and had no other comments. 
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Teacher 05 { F^artnersh i Interview) 

Math Program . Teacher was enthusiastic about the program and explained 
that she asked to participate, despite the fact that she had only one 
eLfc!;hth-grade class and three ninth-grade classes. This teacher liked the 
program because it went alon^ well with what she has always done; there- 
fore, she didn't chaii^^e much. She tried to follow the schedule closely, but 
she somet imes ran out ot time. 

Teacher 3 telt the main strength of the program was that it made her 
teach. Teaciiers have to be prepared. She also liked the idea ot being told 
to push the students, and found that she accomplished more than in past 
vear s . 

According to this teacher, there were no weaknesses m the program, 
except 'that there was not enough time to work everything in. She questioned 
the use' of a diiferent pre- and post-test, and thought there would be 
trouble correlating the two. 

Researchers. Teacher *) had a positive reaction to the meetings, but said 
that she thought some teachers thouglit the proiect "was a bi£^ |oke," or 
that It "would be too much wori.." She said others thought, "Oh, it's easy, 
we'll )ust prptpod like we're dolni^ it." 

^he wondered tiow n.ucti data the observers obtained, and stated that 
tne\ needed to [lavp rowf*. mure trequently. In generdl, she thought there 
would have been more negative reaction to the project it the small nroup 
hadn't met first -ith! ^-hen .;one out and t<ilked to other teachers in a posi- 
tive /VciV . 
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leacher Of) (Partnership Interview) 

Math^ioaia.. All of Teacher 6-s cedents about tL math program were posi- 
tive, because the progran, was exactly what he had already done all these ' 
years anyway. The major strength was that the program was highly struc- 
tured. Teacher 6 was a very structured teacher, and the program merely rein- 
forced her attitudes toward a structured approach. Another strength was the 
story problems. However, she did comment that the story problems available 
to her were so simple that she changed the.. Teacher 6 didn't feel that she 
>nte,rated the storv problems well until the last two weeks. She suggested 
no change .n the program. She did often incorporate the seatwork and home- 
work portions into the same time segment. 

\ 

^"^^^'^ ' thought the fall meetings with the researchers were 
quite good, that there was a true exchange between the researchers and 
teachers. She suggested, however, that two meetings instead of one be held 
With the partnership teachers. 
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TeacherSp? (Treatment Interview) 

Math Prolram , This tocher was verv positive about the project, and it was 
what she had always ^i^e . Its strength, she felt, was in the structure.^ 
The program was 'logical and what all good teachers do. She thought the 
general structure could be applied to any course. 

The proj^am's major weakness was that there was too much time spent 
daily on word problems. She suggested, m terms ot changing the program, 
that more inservice training be used and that the program be used in educa- 
tion c lasses . 

Researchers . Teacher 7 was positive about the meetings and her participa- 
tion. She did, however discuss the exhausting nature of teaching, and said 
that people in research should come back to teach for about nine weeks so 
they could remember what it's really like. 
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ledcl't-r r;H f I re.^tnient Interview) 

Math Prn^vam. Teacher 8's primarv reaction to the program was that it was 
"too ri^id and inflexible. " She felt it was impossible to follow it closely 
because ot the unpredictable nature ot dailv life m school. She pointed 
out that while we vere talking, her class had been interrupted three times, 
twice to call groups of students out to have their teeth checked and once 
to announce an assembly later that day ('/hich would cancel one ot her math 
classes). Because ot these interruptions and the fact that eighth-grade 
st'.i.ients don't behave m predictable ways, she teit that teaching couldn't 
be done m such a routinized way. Teacher 8 suggested that the program was 

^ood as a blueprint for be^lnnlng teachers. In general, she had been using 
the program tor nineteen vears; therefore it was not useful. 

Researchers . Teacher 8 told me she brought up her concern about the pro- 
gram's " int iex ib i 1 1 1 v " at the fall meeting, but was "put down," made to 
feel out or line, and ^ot no support t rom the other teachers. 

She WHS upset tiiat there was no teacher or student interaction with 
the observers, particuiarlv because the students didn't understand wh\ ob- 
servers were tiiere. 

NOff-: Ihis "occurrt^ci" jr tlie trainint; meeting, not at the partnerslup meet- 



Teacher 0*-* < Fredt'iieT-t interview) 

Math Program - ^^he starte-i the proi.'.rarTi with the lower halt of the ei.^hth- 
^rade in two sections hut manv or the stinients had been m special educa- 
tion or remedial classes previously. One section couldn't keep up because 
they neede<i too much drill. So she eventually used the program in one 
cl3SS--a low euhth-i^rade class which used a seventh-i^rade book. 

Teacher '-^ thought the program was not too much ditierent t rom the way 
she had taught m the past; theretore, she didn't change ver^ much. She 
took some tniie before the students tmally got used to the routine. Ihe 
pro^ra- was difficult to implement, however, because it was developed tor 
o e-hour sessions an-l she had onU torty-i i ve-mmute periods. 

The strength of the program was that t was a good approach to math, 
outlined m a va\ which incorporates constant review. "You keep drilling, 
Icheckmg, the re^'ilar old grind without it seeming like that." 

She felt the weakness vis that teachers have to have written problems 
everv day— ir^P'^ss i ^ I e . letcher ^ thought verba 1 i / i n^', was difficult, but 
added that mivhe -^rie <! -i^'t understand what she -.hould have done. Sfie also 
felt that the t-ert, -I'^uteb for development ■Tia\ be too imich for some c!as 
es, but -lOt prouj^ : or ?thers. 

leacher ' s'..rp-.tt^l pittin- some variation into ^chedunn.',. HowH^'^^r, 
m .zei.^'ril, shp still tollowini, the outline, btit is acUhn'.', to it. 
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Appendix 7 

[descriptions of Effects of Program 
Piannmu Practices ot Treatment Teaciiers 



Ihe data pre:.f>:irp ^ 'lere ,,r- .Irawn rron r onver b :it i ons that the two 
classroom, observers b.. : ^^^rs atter thev liad be^un to use tiin pro- 



^ r am . 



In order to "-.sK ot individual teachers, teachers 



are reterre-l to "<>' t^" even though abotit halt tt.e teachers were male. Ihe 
roliowmtf questions ^ere raise<i m t'ue conxersation with teachers: 

!. on the iw-i/e, how lo'i^ -Aj > ou spend planning tor each preparation^ 
Ji^ voi- spend '-ore or less tine planning/ tor t h.e project classes^ 
V lot 'I'ore , More, :>aj'e, Less, \ lot less. 
5. ..ds t-e yi^vr^i:,^ an\ ditrerent' 

Ves ^^"^ 

It I'es , how ' 
il 1. vpproxi-natel V 1 ■ ^i-'utes a 'la> . 

ilso F'ib to n oi,t .;eel.'K lesson plans so thii^ adds additional 

1 1 Te to t i s 1 '.O'iT^t . 

2. Less, hecaiise o-e f>ro^^ct class is i setter ^ Uss than others. 

]. Not reail^ inherent, because the MMh:L prouran> tits exact 1\ what 
the new ."olt hook isl^s them t^ do, so just :n piaiininu normal les- 
sons srip's ilso :oin^ what our pro^ra-. asl< s lor. 

1. Vpproxi ^ite'. iMMUtes. It /.iries ^^uite a Iw t . 

Ijf'^i: .t..;. cue, sh- ha! to vrite out the verbal proLle^^5^ to be 

— e ^.^ntal rn-^^p lesson, artivitv and. or the prohlen,s, 
so it t c- c ' ' . r . 

y.,,. ,;e'i ^rei. diMerent, .r^mU m the t wavs :^en- 

t,0\^^\ i' ' 1 1- • . ^ the -erL.d proi) 1 em so 1 i n^ -jndn>entil 

c o 1 . , 

^ ^ . .,.,,tHS ; !j> . ')^e .-rites out lesson plans ei'^h ^rpia^ i or 
r^.. :.pxr .en., littie ^.!^ plun- n. is nee-ied. 
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J. Scinip. Ail classes take about the same amount ot preparation, how- 
ever, tirst hour is a much better class than second and second often 
t^ets behind and doesn't get evervthing done that she wanted. 
3. Not really ditferent. 
'^^ i- 3-'10 "mutes. She's done it tor so long that it doesn't take too 

1. Pretrv rnuch the same for all. 

3. No (she laughed a little guiltily, but didn't give any apology, 
reason, or comment, just the "No.") 
i>', 1. 2n-3n minutes a day because she's done it for so long, at first 

(or when she gets new books) she spent an hour a day planning for 
each hour ot class time. 

2. More. It took longer because she had to decide on the mental comp 
and seatwork problems and work them into the lesson. 

i. bifrerent in that she was working in the mental comp and seatwork 
prdblems. It was also different because she put in the verbal pro- 
b 1 ems . 

^'^j ]. maniites a dav . She plans 6 weeks at a time and mimeograpiis 

assi:nnr,ent sheets tor t^e students and, tlieretore, she does a lot 
o\ piann>-iL; then; tor daily planning only minutes. 
J. At the he.'innm'^ of the project she did more ('comparing to see how 
what sj-ie va^ doiny fit with the MMEP program). It all tit except 
ror the verHai problem solving so she kept on \Mth her usual 
routiPf^, fxc^-'pt that she tried to work in verbal problems, hut she 
Slid th^t she didn't ^et them started until December. 

riiniitPS a dav. She spends onfj hour a dav planning. 

J . a ' ■ p . 

o 
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3. The or.h, litterence was that she mcluHed a workbook for the verbal 
problems an.i for the mental comp problems. She planned problems 
trO'T. It -or the project classes. 

1. minutes a tlav . 

2 . Same . 

^. Not realK anv ditterent but it did make her more conscious of time 
i I.e., not to spend too much time on some things so she'd have time 
to j,et iii ictivities worked in). 

1. 30 minutes a -lav. ^he likes to plan prett> thoroughlv. 

: . \ 1 X tt it^ . '^re. 

3. The onU real difterence was that she included dai 1> verbal problem 
solvm'^; whereas berore she had iust done verbal problem solving 
as It c i^^e m the re^^uUr 'esson. 

1. Approxi'^atel . 2^ rinutes. 

2 . uet ] r, .t ^ 'liore . 

3. It ^as dirrf-rent because she ^ps more thoroimii witli the planning 
tor one L>ro:t^rt class (i.e., trvmu to work e^ervtbiP^ m nui ^et- 
tm.' t^'M t.-L's riuht>. In her other cL^sses she )«ist plans one or 
rv.o ict: tr.es ^nd then vaits to see -^hat tievelops during; the hon/, 
to ter-r » .tiether there's time tor other activities or what needs 
to ' 'ic^e . 

1^ I. , : inures -ow hec^iuse it's the same book that siie ' s used for 
,ejrs. '-^ :irst seir she spent ^ihout U> Tiiruitt-r. .i dav m [)^^r pre- 
p 1 r it 1 orw 

-fM spe- is P or so minutes a d<i> on the other, but ai;ain, 
s^' SD- his tau.ht t rom th.i^ book tor so lon^- 
>^ j.,^ r,l ,as 'Mt^^-rf^^r m that she worked m the verbal problem 

soi/in_ r ! t t ' Oi' p rjCt i v 1 1 i es . 
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Appendix 8 



Observers' Brief Sketches of Teachers 



ERIC 



264 

Comments About Teachers: Observer 1 
Wasn't very enthusiastic in implementing the program. Most of the qual- 
ity ratings were about 3. Seemed to spend a lot of time on seatwork 
or worksheet review classes. About a 3 on implementation. All 3 obser- 
vations were classified as review. No severe discipline problems, 
though the quality of student attention was mediocre. 
Seemed organized. 
Mediocre treatment teacher. 

Enthusiastic about the program and an enthusiastic teacher. Overall 
quality ratings were averaging 4-5, 4 for implementation quality 
scores. Students were contributing to each lesson, good classroom 
atmosphere. Organized. Quality of student attention high. Excellent 
treatment teacher. 

Abrasive in dealings with students. Had severe discipline problems. 
Was hardly implementing the t reatment— degree of implementation a 1. 
Wasted class time. Quality rating— 2's. Not a good teacher by any 
stretch of the imagination. Terrible treatment teacher. 
Enthusiastic teacher. Implemented the program well— average 4. Quality 
high-4. Time on components was slightly of— that kept her from being 
a 3. Pace was better than most teachers—kept things moving. She was 
creative in using mental comp. Excellent treatment teacher. 
Was initially enthusiastic but seemed to have difficulty getting act 
together. Implementation scores were 4, 3, 2, 3, 2, 1 over my observa^ 
tions. Quality was about 3^ down the line. Spent too much time going 
over homework and on mental computation. Hardly any time on seatwork. 
I would classify her as a good teacher but only a fair^poor treatment 
teacher. Occasionally she'd have to settle the kids down, but they 
were fairlv attentive. HardL^ any time on VP. 
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Slow to use the program. In fact, I doubt she changed her routine at 
all. Spent an enormous 7« of time going over homework. No time on MC or 
VP. Little time on DE. I would rate her a 2- on implementation and 3 
on quality. She had discipline problems; her rapport was not very 
high. A poor treatment teacher. 

Fluctuated quite a bit in implementation. Of the 7 visits, 4 were I's; 
1 was 3; 2 were 4's. Some days she was with it, other days she was 
completely off track. Quality was a consistent 3. Expressed some diffi- 
culty and dislike for having such a rigid, full schedule (time-wise), 
but said she was giving it a try. A fair to poor treatment teacher, 
if we take an average. 

Had good rapport with students. No discipline problem at all. Didn't 
implement the program all that well— about 2+. Quality was a 3 average. 
Of 7 visits she did MC once & VP once. She seemed to stay pretty much 
with what she was doing before the treatment. 

Fluctuated quite a bit in quality of implementation, going in order 
from 4, 4, 1, 1, 2. I think 2 of my later visits caught her on 
unusual days and she did what was best, given the circumstances of 
the situation. She averaged a 4 on quality and I think overall was 
a better treatment teacher than her scores indicate. 
Had serious discipline problems most of the semester ana I suspect 
was nor very. effective as a teacher. She had no real rappcrt and was 
constantly correcting individuals. She averaged a 2 in both overall 
quality and degree of implementation. Toward the end she seemed to 
be making some progress toward treatment implementation. 
Liked the program and made attempt to implement it, though probably 
not as much as she thought she did. About a 3 on quality and a 2+ on 
implementation, had some discipline problems. Too much time on 
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homework, not much on MC or VP. Average treatment teacher, or slightly 
below. 

A good control teacher. Quality about a 4 average. She would have made 
a good treatment teacher because she averaged a 3 on implementation. 
Had good rapport with her students and used more than just the textbook 
in her presentations. 

An excellent control teacher. Quality was between 4-5. Her implementa- 
tion was a 2 because she spent her time on 2 components. One day it 
was DE & PS; another HW & DE, another VP & PS. She had great rapport 
with her students and used more than just the textbook in her presenta- 
tions . 

Had little rapport with her students. When the students disrupted eiass' 
she threatened them with a graded assignment due at the end of class. 
About 70\ of class time was seatwork. She scored a 2+ on quality and 
1+ on implementation. Very little time on development. A poor teacher 
overal i . 

Averaged a 2 m quality and a 2 in implementation. Had good class con- 
trol, fairly good rapport, but tended to be boring, '^he % of time on 
task was a little lower than others because of this, I think. Students 
weren't disruptive, just not engaged. Pretty much a homework, develop- 
ment, seatwork teacher. 

Organized, but iiad soirie discipline problems. Was rather monotone in 
presentation. Averaged a 3 on quality and a 2\ on implementation. Had 
HE in most Cj ol 8) of her lessons, and a substantial development time. 
Had serious discipline problems* No class control. Students did little 
work, and roamed the class m control. Usual practice was some HW, 
then short DE followed by PS for rest ot period. A 1 on implementation 
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and d It on quality. Whatever was learned in this class was done inde- 
pendent of the, teacher. 

Ruled with an iron hand. Students were attentive out of fear more than 
interest. She took pride in calling herself a traditional teacher. 
Was organized. Wasn't much on alternative approaches. Rated a 3 on 
quality and a 2- in implementation. 

A fine teacher. Good rapport. Had students on task all the time. Had 
a faster pace than most teachers. Averaged 3 on implementation and 
^ on quality. Healthy amount of time on development. 
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Comments About Teachers: Observer II 
Seemed unenthus last ic about the project and didn't seem to try to 
implement the program very much. On 2 of my 5 visits she had mental 
comp but on both occasions she said "We better do this today," giving 
me the clear feeling that it was because of my being there. 
Three times her only lesson was verbal problem solving (these were 
weeks apart and problems that she found scattered throughout their 
books or from another book that she passed out (again, like an acti- 
vity for my benefit). 

An excellent teacher who really seemed to try to implement the treat- 
ment. She tended to spend too long go^n^ over homework, reviewing and 
doing mental comp and often had only a short amount of time left for 
development and/or practice seatwork. but it was clear that she was 
really trying to do it all right. 

Mental comp and verbal problem-solving activities were very good. 
A good treatment teacher. 

Would have been the perfect control teacher. The students did crafts 
5 weeks during the program. On these days there was nq lesson, the 
Students sat, visited, and worked on crafts. 

Never did mental comp or anything that remotely resembled the treat- 
ment . 

Was constantly screaming at the students. 

A very Rood teacher who seemed to really try to implement the treat- 
ment. She did most parts each day. Times were off some but in general 
she did well. She was always well in control of the class. 
Seemed to really try (but otten without real success) to implement 
the treatment. She spent way too long going over homework each day, 
even though she tried to hurry it along. 
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About halfway through the programs, she started writing each week's 
schedule on the back b'lackboard. She'd list certain mental cornp, verbal 
problem solving and practice seatwork exercises planned for each day. 
However, usually she'd run short on time ^nd' have to " anndunce thot 
they were going to have to skip at least one of these activities that 
day. Therefore, though she tried, she really didn't implement tT,e 
treatment very well. However, she did seem to really care about the 
program and about doing her part. * . • ^ 

Didn't se^m to try very hard to implement the treatment. She never 
had mental comp and rarefy had verbal problem soWing. 'Her daily 
tine was: go over homework, have a lesson, then seatwork. ' ' ' 
•^I don't feel that she changed much because of the treatment. 

/ , V ■ • 

She would have xita^de a better control teacher. ■ 

I ' ' ' 

Didn't seem to care about trying to do the treatment. Wheneve-r I would 

ask to schedule a visit she wouldn't even note the date or hour. She'd 
just say,;"You won't bother me. I'm not going to chltig* anything." 
She rarelji did mental comp or verbal problem solving. 
She told nje that the reason she volunteered was because when she read 
about the program it sounded jusfc like her u*ual. Later we'added to 
the prograjn and changed the time limits and she said it was too confin- 
ing- 

I don't thfnk she changed much of anything because of the program. 
Even then |er implementation scores were usually fairly high. 
Sometimes would really try to implement the treatment (once she had 
everything. perfect). Other times she wouldn't try at all. She'rarely 
hai^ mental comp or verbal problem solving and her lessons were to. 
iXg. j 
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' , She's. a very gQod, interesting and clear teacher and 1. can't imagine 

any student not liking her or her class. I feel that if she had tried 
on all occasions to implement the treatment, she could have been a 

big help in the study. . 

\ 

^"""^Q A very good teacher who real ly ' seemed to try to implement the treat- 
nt. However, she rarely had the mental comp. 
She usually started her first hour class about 10 minutes early to 
have iPQre time to work things in (15 minutes wao allotted to homeroom 
and as'^so^ as business was completed she began the lesson). ^ 
A goo3 treatment teacher. 

10 Speaks in a dull monotone and then gets after the students for not 
paying attention. Every time I observed her class she told me ^^about 
the low-abUit> students, the high absentee rate and tardiness\ rate 
and J^' they hadn't learned to behave, but how hard she was trying 

^ to straighten them out and how much progress she was making. 

She neve'^r seems to try too hard to implemenr the treatment, but in 
each class she blamed it on the students. In my interview with her 
she told me how thoroughly she was planning so as to work in all of 
the treatment - 

She would have made a .better control teacher. 

11 Never really seemed to try to do the treatment. She would spend about 

s 

20 minutes going over homework and she rarely had mental comp. Halfway 
through the program she asked me about the logs. She had been counting 
the questions the students asked about homework as ^review and counting 
something else as mental comp. I tried to explain itK all to her again, 
but I would guess that at least up to that point she Was checking 
about everything each day without really doing anything- too different- 
ly from before the program began. 
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She would have made a better control teacher. 
12 A very good teacher. She teaches in a very interesting, clear and 

enthusiastic manner. I got the feeling that the students really liked 
her and felt like she really cared about them. 

She was a control teacher. Her daily routine was to go over homework, 
have a 20 minute or so lesson, then have seatwork. 

She would have been a good treatn.ent teacher and from getting to know 
her I feel that she would really have tried very conscientiously to 
implement the treatment. 
13 An excellent teacher. She is very enthusiastic and I can't imagine 
any student -ot liking her or her class. 

She was a control teacher. Her daily routine was a short review over 
the homework, check the homework, a lesson and then seatwork. She had 
excellent discipline up to the seatwork, but there she let them be 
a little too free, in my opinion. 
She vould have made a good treatment teacher. 
14 Always had the students do seatwork most of the hour when 1 was there. 
Usually it was strictly review seatwork. Sometimes it was preceded 
by a very short lesson. My presence seemed to make her nervous despite 
the fact that she was only a control teacher and not being asked to do 
anything special. She just always planned seatwork when I was to be 
there. 

However, that could have always been her routine, but from the reac- 
tions of the student, I question that. She had discipline problems 
often, trying to keep the students working. 
She made a good control teacher. 

A very cooperative, friendly person, but as a teacher she speaks in 
a dull, uninteresting tone which would make it hard for students to 
concentrate on the lesson. p u - 
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She was a control teacher. Daily routine was to go over homework, have 
a 20 minute or so lesson and have seatwork (which sne actively super- 
vised very we 1 1 ) . 

Stood at the front of the room and talked to herself all hour. She 
could teach a 20-30 minute lesson on an hourly review with no one pay- 
ing any attention to her and as long as students were quiet she didn't 

f 

appear to notice. She would turn around and write on the board for 

several minutes at a time wl.ile paper wads flew everywhere. 

She was a control teacher. Her daily routine consisted of: Going over 

the homework, a 20-30 minute lesson, and seatwork. 

She made a good control teacher. 

A non-participating control teacher who almost always just had the 

students work on seatwork. Sometimes it was purely review and other 

times she gave a very short lesson or had one of the students read 

aloud from the book the development. Even m checking homework she 

often had a student read aloud the answers from the book. 

She seemed very unenthus last ic about teaching but she was friendly 

and welcomed my visits. ^ got the feeling that seatwork was the general 

daily routine whether or not 1 was there. She didn't try to have any 

discipline in the class. 

A good control teacher. 

beemed to resent the project at first- She got one cla'ss out ot the 
study and tried to get the other out. 

However, after we got gomg 1 think she felt all right about it. She 
got so she'd visit with me before, after, and even during class (seat- 
work or boardwork ) . 

She was a control teacher. Routine was varied but included a lot of 

practice boardwork. 

A good control teacher. 



I 19 \n excellent teachtr. She was always in complete control of the class 
/ /with no discipline or other problems. She was very well oxjganized, 

clear, enthusiastic, and interesting. 
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Appendix 9 

Observational Forms and Teacher Logs Used in the 
Eighth-Grade Mathematics Project 
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Coding Instructions 



Junior High Mathematics Study 



On the accompanying coding form indicate in the first column 
the part of the treatment the teacher is engaged in using the following 
codes: RE for review, HW for collecting, grading and dealing with 
homework, MC for mental computation exercises, DE for development, PS 
for practice seatwork, PB for practice boardwork, VP for verbal problem 
solving or TR for transition. (See Description of Lesson Components 
for a description of each of these.) Then place the start time of the 
activity in the next column. 

At the end of each part, rate the quality displayed by the teacher 
during that activity according^to the scales described in the Quality 
Rating Scales for Lesson Comp^ent Parts. Whenever the teacher stops 
the particular activity (ever/ if only for a few minutes), code the start 
time Of the next activity and assess the quality of the previous activity 

Before class, randomly select 6 students as follows: 2 high 
achievers, 2 average, and 2 low achievers from those suggested by the 

m!J^r..f°^®fu^ c^Wi:^; ''^^^ ^^^^'^ student numbers in the column 
marked List the 6." (1-4 means first row, fourth chair.) Then each 
time one of these students is called on to answer a question, put a 

/ beside the student number. If the student then answers correctly, 
make the- mark into an "X." Likewise, whenever one of these 6 asks an 
academic question, place an "A" in the appropriate column. If he asks 
a nonacademic question, put an "N." A seating chart for each class is 
necessary in order to later link student numbers with. student names 

Every 10 nnutes make a complete sweep of the room, coding each 
student s behavior as either "on- task" or "off-task." Put a for 

on-task" or a "-" for "off-task." If in doubt, continue to observe 
the student until he either shows signs of being "on-task" cr of being 

oTT-task. Then proceed to the next student and code his behavior. 

4j ^^.V^ minutes relist the 6 selected student numbers along 
Side the time-on-task student numbers for that 10-minute interval and 
continue to mark /, X, A or N. Also continue coding time-on-task. 
\nb ^J®''? ?® r t|nie-on-task measure for each student for each 
10-minute ^nterval of classtime, and a record of the number of times 
each selected student was called on, etc., during the interval 
i *L. n °^ development phase of the class period, fill 

nJ ;;«DfveloP"«"t codes at the far right of the form. (See Description 
of High Inference Scales.) 

At the end of the class period, place the word "END" in the 
first column and the concluding time. Fill in the Sunmary Codes at 
the far right of the form (again refer to the Description of High Inference 
Scales ^jr.flf^^^ cat on), and list the major topic(s') of the class pIrfSd 

...1,. u l^.l^''- s^^® (^^^^"^ List immediately after the parti- 
cular phase of the class period indicated. Place a check mark beside 
each statement that holds true. 



DATE 



SCHOOL 



TEACHER 



TIME 



OBSERVER 



OBSERVATIOM # 



P ARTNE R, TREATMEMT, CONTROL 




DEVELOPME«r 

CODES 



CLARITY 

1__2_3_4_5, 

EMTHUSIASM 

1_2_3_4_5 
MANAGERIAL 
1_2__3_4_5_ 

ACCOMPLISHMENT 
1_2_3_4_5_ 

INTERACTION 
1__2_3_4_5_ 

QUALITY 
1 2 3 4 5 



SUMMARY 
CODES 

CLARITY 

1_2_3_4_5_ 

ENTHUSIASM 
1_2_3__4_5 

MANAGERIAL 
1_2_3_4_5__ 

ACCOMPLISHMENT 
1_2_3_4_„5__ 

INTERACTION 
1__2_3_4__5_^ 

QUALITY ^ 
1_2_3_4_5_ 

IMPLEMENTATION . 
1 2 3 U 
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CHECK LIST 
Junior High Mathematics Study 277 
Honday ? Date Teacher 



^"^^^ J Observation # 

Place a check mark (^) ^ m the blank next to all statements that hold true 
INTRODUCTORY PHASE 



1- A brief review 

context. 



7. 
8. 



of previous work was conducted in a meaningful 

2- 2-5 minutes w^s spent checking homework. 

^- '"^ minutes w^s spent on mental computation. 

a slow transition teethe main part of the lesson. 

CeVELOPMENT 

5« Development moved too slow. 

^« Development moved too fast. ^ 

Teacher paced development with progress of students. 
21 deSe?Spme;:rphase' — controlled practice during 

T^L^"?!}-'' SP«"5. 15-21 minutes developing the mathematics in the 

lesson (disregarding verbal problem solving). 

SEATWDRK 

Teacher spent 10-20 minutes on seatwork. 

insured that students were actively engaged in 
seatwork during the first 1% minutes. s«6«« J-n 

Jl;;e^e?^^rs::LnrjLiio%£? ^^^^^^^^ ^^^^ -^^-^^ 

fea^Sor'k pha"e'''' accountable for the seatwork at the end of the 

Seatwork directions took longer than one minute. 

The teacher assigned homework. 

VERBAL PROBLEM SOLVING 

Sjvtog^^^'' ^P^"^ approxima - ely 10 minutes on verbal problem " 

JStvJng^^^'' "P^"' majox^.y of the period on verbal problem 

18. The following verbal problem solving techniques were used. 
_____ Problems without numbers. 

Students were asked to create and write verbal problems. 

Students estimated the answers to verbal problems. 

Attention was given to the reading of verbal problems. 

Students were asked to write open sentences. 

- on ' 



12. 
13. 
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Description of Lesson Components to^be Coded 
Junior High Mathematics Study 



The following is a description of each of the phases of the class 
period which will be coded. Whenever the teacher's behavior fits the 
particular description, code it as follows: 

Development {Dt) 

The development portion of the class period is that part of the 
lesson devoted to establishing comprehension of skil Island concepts. 
Development relates almost exclusively to work with new ideas, concepts 
and skills. Activities used during this phase often include teacher 
explanations and demonstrations, and may include the use of manipulative 
materials, concrete examples, making comparisons and searching for patterns, 
class discussions, group work, and the use of audio-visual materials. 

Often during some part of development, the teacher will pose oral 
questions to students to assess their comprehension of the topic at hand. 
The teacher may also use controlled practice during this phase. That is, 
one or two problems are given at a time and then immediate feedback is 
given on the correctness of responses. This is usually done while the 
teacher is trying to identify and correct student misunderstandings. A 
brief summary of the prerequisite ideas and skills necessary to do or 
understand the topic of the day is considered part of development. Note 
that its f6cus is to facilitate the development portion of the lesson 
and not simply to refresh past skills and concepts. 

Practice Seatwork {PS) 

Seatwork refers to practice work which students complete individ- 
ually at their desks. Seatwork refers to written work only and does not 
Include oral practice. 

Practice Boardwork ( PB ) 

Boardwork refers to practice work that students complete individ- 
ually at the board. Like seatwork, this work relates primarily to work 
with new ideas, concepts, skills and objectives which were presented in 
the development phase of that day's class period. 

Review (RE) 

Review refers to work on old^ material . It deals with concepts 
which the students have had prior to the particular day in question 
(whether it be material from the previous day, or from much earlier). 
Use of games, puzzles, worksheet<^, etc., which are used to review skills 
and ideas fall into this category. 
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Mental Computation (MC) 

Mental computation Is computation that Is done without the aid 

of pencil and paper (or mInlcalciJator) . The processing Is done mentally. 

The problems which the students ffre asked to solve mentally may relate 
either to new or to old Ideas. 

Homework (HW) 

This phase Includes all activities Involving homework. Thus, 
It Includes the teacher reading off the correct answers to the homework, 
the In-class grading of homework, the showing of solutions to homework 
problems, and/or the collecting of homework papers. 

Transition (TR) 

Transition refers to the process of going from one phase of the 
class period to another. Transitions should be coded only If they are 
noticeable (I.e., Involve a minute or more, or are not done smoothly). 
Transition also Involves the period of time from when the class Is 
scheduled to begin and wnen It actually gets productively under way. 

Verbal Problem Solving (VP) 

Verbal problem solving refers to the time the teacher spends 
working on word problems. This phase often Includes the teacher demon- 
strating problem solving strategies, solving problems, having the students 
estimate answers to verbfl problems, and/or having the students solve 
verbal problems. 



Quality Rating Scales for Lesson Component Parts 
Junior High Study 

The quality of each lesson part coded will be given a quality 
rating based on a five point scale with 5 = excellent, 4 = very good, ^ 
3 = average, 2 = fair, and 1 = poor. The following characterfzes some 
of the key dimensions considered in making these ratings for particular 
lesson component parts. 

Review ( RE) ^ ^ ^ 

Reviewed concepts and skills previously studied in an Interesting, 
beneficial, and efficient manner. 

vs. 

Did a very Inadequate job of reviewing the concepts and skills associated 
with previous work. 

Mental Computation ( MC) 

Asked challenging and skill-building mental computation exercises 
in an interesting manner or format. 

vs. 

Asked mental computation exercises that were of inappropriate difficulty. 
The work with mental computation was Inefficient, not well organized, and 
uninteresting. 

Homework (HW) 

Dealt with the homework in a very efficient, effective, interesting, 
and beneficial manner, without spending an unnecessarily long amount of time 
on it. 

vs. 

Dealt with the homework in a very routine and inefficient manner. 

Development ( DE) i 

In development the teacher 

1. briefly focuses on prerequisite skills and concepts, 

2. focuses on meanirtg and promotion of student understanding by using 
lively explanations, demonstrations, process explanations, illustrations, 
etc • 

3. assesses student comprehension by using process/product questions 
(i.e., active interaction). 

4. repeats and elaborates on the meaning portion as necessary. 
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The above. very accurately describes the teacher's actions 
vs. 

The above does not describ^the teacher's actions or describes them in a 
very minimal way. 

Practice Seatwork (PS) 

^Provided uninterrupted, successful practice, in which everyone was 
involved imnediately and then sustained involvement. Students were alerted 
that their work would be checked and they were held accountable for it. 

vs. 

The seatwork was handled inefficiently. 

- Practice Boardwork ( PB) 

Made sure that everyone (whether at the board or at their seat) 
got involved immediately and maintained involvement. 

vs. 

The practice boardwork was not effective and was handled inefficiently. 

Verbal Problem Solving (VP) \ 

The session was efficiently conducted. Appropriate problems were 
used, interest was maintained, strategies were discussed, solution methods 
were discussed and demonstrated, and there was an opportunity for questions. 

vs. 

The verbal problem solving session was poorly conducted and resulted in la 
very little benefit to the students. 

Transition (TR) 

The transition was very smooth and efficient. Momentum and interest 
were maintained and though in transition, time was not wasted. 

vs. 

The transition was unnecessarily long, boring and unprofitable, such 
that Valuable time was wasted. 
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Description of High Inference Scales 
Junior High Mathematics Study 

"t 

Clarity '•' 

Clarity refers to the degree to which the teacher's presentation 
of material and^ his substantive interactions with students are under- 
stood by them. 

5 Very high clarity. The teacher's explanations are ea^y to understand 
and pupTl question s are adequately answered. The teacher seems aware 
of the pupil's levels, sensing problems they are having or may have. 

4 High clarity . Between moderate and very high. 

3 Moderat e clarity. The teacher seems to be understood by most.pu^ils, 
but not all of th e time. Sometimes the teacher is confusing and 
vague. 

2 Low clarity . Between very low and moderate. 

1 Very low cfarity. Pupils seem very confused by the presentation. 
The teacher canno t answer the pupils' questions, or answers them in 

an unclear manner by using concepts and term: the pupils are apparently 
unfamiljg^th or by being overly complex and ambiguous. 

Enthusiasm • 

This scale is used to judge the extent to which the teacher dis- 
plays interest, vitality, and involvement in his subject and his instruction. 

5 V ery high enthusias The teacher is sti,u1ating, energetic, and 
very aU-rt. He seems interested and involved in what he is teaching, 
moves around, gestures, inflects voice. 

4 High enthusiasm . Between moderate and very high. 

3 Moder ate enthusiasm . Occasionally the teacher seems interested and 
involved; some display of activity, such as gesturing. Sometimes 
the teacher is dull, routine, and lacking in vigor. 

2 Low enthusiasm . Between very low and moderate. 

1 Ve ry low enthusiasm . The teacher's behaviofc is lethargic, dull, routine 
a minimum of vocal inflection, gesturing, movement, or change in facial 
features. The teacher appears to lack interest >ft,what he is doing. 
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Managerial 

mAn.n.v.J!'^\5f?^^l^ 1^^^.^° ^"^9® ^^^"^^^ °^ effectiveness of the 
managerial skills displayed by the teacher. 

5 Very high managempnt. The teacher is an effective manager. 
She structures, maintains and monitors learning activities. 
She runs the class with a minimum of disruptions. 

4 High management. Between moderate and very high. 

3 Moderate management. Occasionally the teacher is an effective 
manager; some display of structuring, maintaining and monitoring 
learning is present. Sometimes she manages the room very ineffectively 
and allows too many disruptions. 

2 Low management. Between very low and moderate. 



1 



]ow management. The teacher manages the classroom very in- 
efficiently Wlri¥ffectively. Too many disruptions are tolerated. 



Accomplishment Index 
5 
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Very high accomplishment. The teacher accomplishes a remarkable 
amount during the class period in terms of the number of examples 
used, the number of problems worked, the amount of material covered, 
and so on. in relation to what seemed possible. 

High accom plishment . Between moderate and very high. 

Moderate accomplishment. At times the teacher seems to be 
accomplishing a lot but at other times things drag with very little 
being accomplished, in relation to what seemed possible. 

Low accomplishment. Between very low and moderate. 

Very low accomplishment. The teacher accomplishes very little 
compared to what seemed possible. 

Interaction Index (excluding seatwork) 

5 Very high participation. The teacher's behavior patterns elicit a 
large amount of active student participation and interaction. The 

Ihe^faVr nf^ir!!f/ff."r';'V"^^^^'^' an active part in the lesson. 
IrlnLnl n ^ ^ Self-initiated questions and tiiHhiV questions. 
Frequent question and answer sessions are observed. 

4 High participation. Between moderate and very high. 

3 Moderate participation. Occasionally there is some active student 
participation and interaction, but at other times there is very little. 

2 Low pa rticipation . Between very low and moderate. 

^ l^' ^WrKin^r^l°" \J^?^" "° student participation 

ana interaction during the lesson. k ^ 
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Implementation . 

Use this scale to indicate how well the teacher implemented the 
pre^fcribed treatment behaviors (circla one). See the attached page for a 
description of the major parts of the treatment program. 



Implemented 
all major 
components 
of the 
program 



Implemented 
most of the 
major com- 
ponents 



Implemented 
about one- 
half of the 
program 



Implemented 
some of the 
program 
components 



Implemented 
very little 
of the program 



Overall Quality ^ 

Describe the teacher's overall quality based on the entire class 

period, 

5 4 3 2 1 

Excellent Very Good Average Fair Poor 
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Treatment Program Descrfptfon 
Junior High Study 

The treatment involves the following: 

1. The beginning portion of the lesson (first 12 minutes) should 
have three parts: 

a. A brief review, 

b. Checking of homework, and 

c. 3-5 minutes of mental computation exercises. 

2. Approximately 10 minutes daily should be spent on verbal problem 
solving. 

3. Approximately 20 minutes daily be devoted to developing conceptual 
understanding of mathematics. 

4. Approximately 30 minutes worth of homework be assigned each night 
.except Friday. 

5. Approximately 10-15 minutes of seatwork be given daily to provide 
uninterrupted successful practice. 

6. The first 20 minutes each Monday should be spent on review and the full 
period be used for review every fourth Monday. 

7. The teacher should get everyone involved in the seatwork inmediately 
and keep them involved. 

8. The teacher should make the students accountable for the seatwork. 



O . 10/79 

ERIC 



NAME 



SCHOOL: 



WEEKS BEGINNING & 



Put a checker) in the columns that apply and fill in other appropriate information 

STRATEGY USED 



DAY OF WEEK 



MONDAY 



TUESDAY 



WEDNESDAY 



thi"^:day 



FRIDAY 



MONDAY 



TUESDAY 



WEDNESDAY 



THURSDAY 



FRIDAY 







z 








o 






tu 


»— 1 


S3 






< 


»- »- 




o 








UJ 


ZD 


Z UJ 


UJ 


zn. 






1— i 


o 


2: 




> 


o 




UJ 


^ 




O -J 








CM UJ 




o 


-J 


> 


u. 

UJ 


UJ 


TA 

I M 




»— 1 


s: 




o 


cc 


o 


UJ 




CO 


3: 


51 


< o 



2: 



00 

UJ _i 

»- CO 
Z3 O 

z a: 

I— I 



r-f CO 

(X. 
»- UJ 

o 

CO z 

< o 



i S E 

I— CO 

H-i 00 Qc: 

3: Qc: UJ CD 

UJ z 

CO CO 00 « 

LU :3 Z UJ < p^. 

-J z »- -J ^ 

CO »— CO »— ' 3^ 

O I- ^ o »- i/> 

a: oc: oc: oo z 

Ou O 3 CL UJ < 



< 

CO 

cc 



00 



Ou 

O 00 
UJ 
CD O 



Q CO »— »— 

< O z 

LU a: oc: UJ 

a: 3 ^ 



SEATWORK HOMEWORK 
PAGE/ PROBLEM # PAGE/PROBJ 



COMMENTS* 



00 



* Please no 



te review days, test days, assemblies, shortened periods. quizzes.etc. 
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DESCRIPTIONS 0^ TIME ALLOCATIONS 287 
Junior High Mathematics Study 
DAILY SCHEDULE FOR TUESDAY - FRIDAY 

Phase 1: Introduction should include: 

1. 1-2 minutes on review of concepts and skills 
associated with the homework. 

2. 3-5 minutes spent checking, collecting, and 
dealing with homework assignments. 

3. 2-5 minutes spent on mental computation. 

Phase 2: Approximately 28 minutes be devoted to development of the 

mathematics of the lesson. This phase should include four parts: 

1. Verbal problem solving (10 minutes). 

2. Comprehension phase 

3. Teacher questions to assess comprehension 

4. Controlled practice 

Phase 3: Approximately 15 minutes be spent on seatwork. 
Phase 4: Assign Homework (Monday - Thursday). 



SCHEDULE FOR MONDAY 

Phase 1: The first one-half of each Monday's class period (about 25 minutes) 
should be devoted to review/maintenance. 

Phase 2: Approximately 20 minutes on development. 

1. Verbal problem solving (10 minutes). 

2. Comprehension phase 

3* Teacher questions to assess comprehension ^ 

4. Controlled practice 
Phase 3: Approximately 10 minutes of seatwork. 
Phase 4: Assign Homework 




SCHEDULE FOR EVERY FOURTH MONDAY 

The entire mathematics period should be devoted to a cumulative review/maintenance 
session, every fourth Mi^nday. 

, ! ^ ^ 
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TIME SCHEDULE 
Junior High Mathematics Study 

INTRODUCTORY PHASE (12 minutes) 

Review of concepts and skills associated with the homework 
(1-2 minutes), 

Checki.ig, collecting, and dealing with homework assignments 
(3-5 minutes). 

Mental computation (3-5 minute^). 
DFVELOPMENT (28 minutes) 

Verbal Problem Solving (10 minutes). 
Comprehension Phase 

Teacher questions to assess comprehension. 
Controlled Practice. 
SEATWORK (15 minutes) 
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Appendix 10 

Achievement Tests Used in Junior High Project 
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Pre Test 



NAME: GRADE: 

TEACHER: CLASS PE^^IOD: 



JUNIOR HIGH SCHOOL: 



PLEASE DO NOT TURN THE PAGE UNTIL YOU ARE TOLD. 



r 
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I * * 4 
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DO NOT BEGIN UNTIL DIRECTED 



292 



ADDITION 

Express answers in their lowest terms 
Example: 2.1 
J - 1 



1. 56 + 63 = 



DO ALL OF YOUR WORK ON THIS SIDE 



2. 98 

+ 76 



/7V 



3. 387 
+ 34 



4. 2 . 1 



5. 1 . 1 
7 * T 



7/ 



5^ 



7. .72 + 1.6 « ^.3^ 

8, 26 + N « 49 



9. (4X3) + (6X8) = 60 
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ADDITION Continued 
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DO All OF YOUR WORK ON THIS SIDE 



to. 3 feet 6 inches 
* Z feet 8 inches 



6 ^ecf ^ I'ncftes 



11. 16 + 2 ^ 2 , / 



12, -4 + 8 + 16 = OC> 



13. 42 . 53 



14. 



(3) + (-5) =_r2. 



15. 



35 + ll % 



5^ 



16. (-37) + 48 + (-13) = 

PRIME FACTORS 

Circle the prime factors . 

17. © 4. (D 10, 12. di) 

g) 22 

G1v# the lowest common muUiple (prime 
factors) of these numbers . 

18. Lowest prime factors of 12 = 3 Q£ 
09. Lowest prime factors of 15 « ?>^^ or 

20. Lowest prime factors of 30 Cif 



44a. possible- I p^-o^^^- 



3 



SUBTRACTION ' . on All OF YOUR WORK OH THIS SIDE 

Express answers In the ir lowest terms. 

21. 214 
> 87 



22. 8 
9 



6 
9 



23. 3 . 1 / Vu 
4 2 ^ 



2*- 4J - 4 



25. 1.28 - .39 



12- 



26. 82 - N '= 48 



27. (7X9) - (6X3) = _Mf.. 



28. 4 feet 3 inches 
> 3 feet 4 Inches 

I - ^f'i kit 



29. if 
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SUBTRACTI6N Continued 



DO ALL OF YOUR WORK ON THIS SIDE 



30. <-13) - (4) - -/7 



31. 15 A _ 3/ 

To - % ^ 
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3r. (-28) - (-7) = / 



33. 



3f - if - i^ 



Ik. 37 



34. (-10) - (+20) - -36 

35. A - il - I'/r 



kli 



MULTIPLICATION 



Express answers tn their lowest terms . 



36. 68 



X 7 



37. 57 
, X74 



38. 698 
X 93 
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MULTIPLICATION Continued 



DO ALL OF YOUR WORK ON THIS SIDE 



41. 15« of 400 = 



42. 600 
X.17 



43. 4^ - 



44. (3X3) X (5X8) = 



45. (.25 X 172) X 4 = . 172 



46 



48. 2^ X 42 V 



49. -8 -4 -Ji2 



DIVISION 
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DO ALL OF YOUR WORK ON THIS SIDE 



Express answers in their lowest terms . 
50. 86 14386 



P?3 

51. 58 16,994 



13b 

52. .17 I22.I 



53. 3 . 



1 . 



Lei' 



54. 1 5 

7 * ^ 



VV6 



55. 17 « % of 85 



56. 20 = X of 80 



57. 90 = % of 200 
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ftivT' IQN Continued 
58, (9X8) * (2X4) = __2_ 



DO 



f^ll OF YOUR WQR'^ THIS SIDE 



ids 



59. 4 * *l 



60. *^ = 7- 



61. = 



r 



UHte these Hprlmals as fractions: 

or or <yr 
. 2.375 = ? fTPff n t-*^^ - ' - 



62 



63. 0.92 = 



2^ 



64. 1.15 = laSk 3k. 



Virl tA these fr^^^nns as decimals: 



DIVISION Continued 



DO ALL OF YOUR WORK ON THIS SIDE 



66. 5 



^ ■ .JO or .9 



WORD PROBLEMS 



68. How much will a dozen apples cost If 
3 apples cost 30i? 



69. How much can we spend for the class 
party? The parents gave us $5.00 
and 25 children brought a dime 
each. 



70. Jim found 25 golf balls. He will 
keep 10 and give 1/3 of what is 
left to each of 3 friends. How 
many will each friend get? 



71. Doug bought a bike for $30 and 
sold It for $40. Then he bought 
1t back for $45 and sold it again 
for $50. How much profit did he 
make altogether? 
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WORD PROBLEMS Continued 



00 ALL OF YOUR WORK ON THIS SIDE 



72. A coat was reduced ZS%. The price 
now is $30.00. What /<as the origi- 
nal price? 



GEOMETRY 



73. 




74. 




75, 



76. 



a = 4 
b = 3 
c = 3 
What is the volume? 



a - 10 

b = 12 

What is the area? 



J2CL 




or 



This is: 

a) « a right angle . 
( ^) « an acute angle^ 

c) « an isosceles angle. 

d) " an obtuse angle. 



GEOMETRY Continued 
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DO ALL OF YOUR WORK ON THIS SIDE 



77. 




This Is: dt Of o)o\uSC aojff 

a) « a right angle. 

b) - an acute angle. 

c ) = an Isosceles an gle. 
0f - an nhtii<;p anolpT*!^ 



78. 



1^ 



<{0 



This Is: Q Of C^ k'i C\r\O^I C 
G) = a right angle^ 

b) ' an acute angle. 

c) ■ an isosceles angle. 

d) " an obtuse angle. 



79. A ra^ is: ( Circle the answer .) 




0 



Write these percents as decimals . 

80. lox - >/ or .Id 



o 81. 33k - iSilif .Tdr ,33 or .3^3. 
ERIC - «s I 



302 



Write these fractions as decimals. 



DO ALL OF YOUR WORK ON THIS SIDE 



Write these fractions as decimals and 
pcrcents . 



Post Test 



1 4 ItAathematics: Concepts 
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SAMPLE SI. 1006 is read 

A. one hundred six 

B. one hundred sixty 

C. one thousand six 

D. ten thousand six 

« 

\ 



Direetiont: Answer these questions. 



What is the place value of 4 in 14,050,390? 

A. Ten thousands 

B. Hundred thousands 

C. Millions 

D. Ten millions 



2. 569 + 793 is closest to 

A. 600 + 800 

B. 600 + 700 

C. 500 + 800 

D. 500 + 700 



3. 30,680 is the same as 

A. (3 X 1000) + (6 X 100) + (8 X 10) 

B. (3 X 10.000) + (6 X 100) + (8 X 10) 

C. (3 X 100.000) + (6 X 1000) + (8 X 10) 

D. (3 X 100,000) + (6 X 100) +(8 X10) 



67,439 rounded to the nearest hundred is 

A. 87.000 

B. 87.400 

C. 87,440 

D. 87.500 
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5. What number belongs in the box? 
123 + □ = 232 

A. 355 

B. 255 ^ 

C. Ill 

D. 109 



6. Which is the next number in the pattern? 
4, 5. 7, 10 

A. 11 

B. 12 

C. 14 

D. 16 



The least common multiple of 10 and 15 is 

A. 30 

B. 60 

C. 90 

D. 150 



8. The greatest common factor of 30 and 75 is 

A. 5 

B. 6 

C. 15 

D. 25 



The prime factorization of 48 is 

A. 2X2X2X2X3 

B. 2X2X2X3X3 

C. 2X2X3X4 

D. 2 X 3 X 8 



OO ON TO THE >IEXT PAGE. 
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10. I is equal to 



A. 3 

"I 



11. Which symbol belongs in the circle? 



A. < 

B. > 

C. = 

D. > 



12. l| is equal to 

"I 

c.| 

"I 



13. Which decimal tells how much is shaded? 















■ T 





























































































































































































A, 2,1 

B. 21 

C, 201 

D. o^^ 
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14. What is the p!ace value of 2 in 5.26? 

A. Tenths 

B. Hundredths 

C. Thousandths 

D. Tens 



15. What is the place value of 7 in .6279? 

A. Ten thousandths 

B. Thousandths 

C. Hundredths 

D. Tenths 



16. 2:^ is equal to 

A. .023 

B. 23 

C. 2.03 

D. 2.3 



17. i375 is equal to 
A. 
B. 

D. 



10 

21 
100 

75 
1000 
75 



10,000 



18. Which symbol belongs in the circle? 
.019 O 02 



A. < 

B. > 

C. = 

D. > 



GO ON TO THE NEXT PAGE. 
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19. What is the solution of this proportion? 



12 i 



A. 4j 

B. 8 

C. 9 

D. 18 



20. 85% is equal to 

A. .085 

B. £5 

C. 8.5 

D. 85 



2^. What number belongs in the box? 
*2 + "2 = □ 

A. -4 

B. -1 

C. 0 

D. +4 



22. Which of these equations has 4 as its solution? 

A. 12 - n = 3 

B. n - 12 = 3 

C. f«12 

D. 3xn=12 



23. What is the solution? 
«-5 = 10 

A. 2 

B. 6 

C. 15 

D. 50 
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24. 63 is equal to 

A. 216 

B. 36 

C. 12 

D. 8 



25. Which point shown below c^responds to 
(-3. +2)? ^ 





A 




-♦4 
















-♦2 










































4 - 


1 




0 


"'I 




2 ♦ 


3 ^4 








--2 
















--3 
















--4 











A. Point P 

B. Point Q 

C. Point R 

D. Point S 



26. Which polygon is congruent to this polygon? 




A. 



B. 



C. 



D. 
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27. Line k is perpend^tular to line n. 
Line m is parallel to line n. 



30. What is the volume of this rectangular prism? 




Therefore, it must be true that 

A. line.fc is perpendicularno line m 

B. line k is parallel to line m 

C. line k is parallel to line n 

D. line m is perpendicular to line n 



28. Line segment $ is how many centimeters longer 
than line segment r? 



V 



i ri t]'llM|l.ii|..,.|!iu|niljlll.|...| l..|lll|..i|nU illljlluji 
i I 5 3 ' 4 5 6 7 



I 2 3 
c«ntimtt«ri 



A. 15 

B. 2 

C. 25 

D. 3 



29. What is the degree measure of angle LO^P. 
M 




\ 
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A. 135** 

B. 125^ 

c. 

D. 




5 m 



A. 12 cubic n\eters ^ 

B. 20 cubic meters 

C. 27 cubic meters 

D. 60 cubic meters 



STOP HERE. 
END OF TEST. 
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SAMPLE 



81. 




A. 15 

B. 21 

C. 35 

D. 71 

E. None of these 



Direetiona: Work these problems. 



403 

3847 
+ 629 



2. 



8392 
5794 



4005 
- 918 



4. 




er|c 



A. 4979 

B. 4969 

C. 4879 

D. 4869 

E. None of these 



A. 3598 

B. 3406 

C. 2608 

D. 2598 

E. None of these 



A. 3087 

B. 3097 

C. 3187 

D. 4912 

E. None of thdse 



5. 6184 
K 7 




7. 285 X 60 = 



a 384 
X507 



9. 9^3? 



A. 2022 

B. 2012 

C. 1922 

D. '1812 

E. None of these 



10. ^1^S^ 



A. 43.768 

B. 42.788 

C. 42.768 

D. 42.288 

E. None of these 



A. 1045 

B. 1025 

C. 845 

D. 287 

E. None of these 



A. 1680 

B. 1710 

C. 16.800 

D. 17.100 

E. None of these 



A. 21.888 

B. 194.188 

C. 194.688 

D. 194.888 

E. None of these 



A. 47 

B. 47 R8 

C. 48 • 

D. 49 

E. None of these 



A. 2395 R2 

B. 2393 R3 

C. 2385 R2 

D. 2383 R3 

E. None of these 



AO ON TA THf NrvT PAnr 
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II. 48^4471 



12. 13T 10,920 



13. 231 )21.947 



A. 87 R9 

B. 89 R12 

C. 93 R24 

D. 94 R11 

E. None of these 



A. 83 R7 

B. 84 

C. 830 R7 

D. 840 

E. None of these 



A. 94 R133 

B. 95 R2 

C. 96 R13 

D. 97 

E. None of these 



14. 



$24.10 
- 13.67 



e 



1 ^ 

er|c 



17. $14555 ■»■ 7 = 



A. $20.65 

B. $20.75 
'C. $27.50 

D. $27.65 

E. None of these 



18. 



9.97 
+ 6.042 



19. 5.4 + 8.23 = 



A. $11.57 

B. $10.57 

C. $10.53 

D. $10.43 

E. None of these 



16. 3 X $46.08 = 



A. $128.04 

B. $12824 

C. $138.04 

D. $138.24 

E. None of these 



16. 60 X $4.22 = 



A. $243.20 

B. $25320 

C. $2432.00 

D. $2532.00 

E. None of these 



A. 15.012 

B. 15.1012 

C. 15.912 

D. 16.912 

E. None of these 



A. 8.77 

B. 13.63 

C. 14.63 

D. 87.7 

E. None of these 



20. 



2.053 + 14.6 + 9.75 = 

A. 26.403 



B. 26.503 

C. 30.74 

D. 31.74 

E. None of these 



21. 



6.41 
- 1.5 



A. 4.91 

B. 5.11 

C. 5.91 

D. 7.91 

E. None of these 



22. 15.3 - 6.445 = 



A. 8.865 

B. 8.945 

C. 8.965 

D. 9.145 

E. None of these 



GO ON TO THE NIXT PAOI. 



Mathematics: Computation 



311 



23. 



27. 



3.75 
X 4 



A. 1.48 

B. 1.5 

C. 14.8 

D. 15 

E. None of these 



24. 6.7 X 1.1 = 



25. 711665 



A. 1.34 

B. 7.37 

C. 13.4 

D. 73.7 

E. None of these 



A. .0295 

B. .295 

C. 2.95 

D. 29.5 

E. None of these 



26. .0156 + 1.2 =* 



A. .0013 

B. .013 
\C. .13 

D. 1.3 

E. None of these 



Find the number that makes the sentence 
true. 



3 is □ % of 4. 



A. 25 

B. 50 

C. 65 

D. 70 

E. None of these 



ERIC 



Directions: Work these problems. Express 
fractions in lowest terms. 



28. 



29. 



30. 



31. 



-1 + 
15 ^ 15 



2+2 = 



3| 



+ 9: 



D H 
30 

E. None of these 



A ^ 
^- 15 

^- 15 

C.f5 

E. None of these 



A. 8§ 

B. 8| 

E» None of these 



A. 12l 

B. 12§ 

C. 13 

D. 13| 

E. None of these 
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32. 



3 3 

4 S 



33. 



2 _ 



34. 



35. 



5 1 

6 " 4 



8^ 
^3 



-1 



36. 3X4 



1 

ERIC 



A.0 
B. 
C. 
D. 

E. None of these 



1 
S 
± 
20 
7_ 
20 



A- I 



B. 



2 
9 



D. 1 

E. None of these 



A. 
B. 



12 

12 
3 
4 



E. None of these 



A. 6| 

B. 7I 

C. 7| 

D. 7| 

E. None of these 



A. 3 
B. 



E. None of these 



37. 



2x3 = 
5^4 



38. aj X 8 = 



39. 4+5 



3 _ 



40. 



3 
5 



_9 _ 
10 ~ 



B. 



C. A 



D. ^ 



1 

4 

3 
5 
3 
10 
± 
20 



E. None of these 



A. 28 

B. 27 

C. 26 

D. 25 

E. None of these 



A ^ 
A. 3 



20 
3 



B. 

C. 3 

D. 6 

E. None of these 



A. I 



6. 



2 
5 



E. None of these 



STOP Hint. 
END OF TEST. 
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SAMPLE 

81. Joan plans to buy some beads to make 
4 necklaces. She needs 30 beads for each 
necklace. How many beads should Joan 
buy? 

A. 34 

B. 70 

C. 102 

D. 120 



Direction$: Work these problems. 

The boys and girls of the Elmwood Community 
Center had a talent show to raise money for a new 
roof. Tickets to the show cost S,50. There were 24 
girls and 18 boys in the show, and 20 other boys 
and girls worked on the show but were not in it. 



1. How many people were in the talent show? 

A. 38 

B. 42 

C. 44 

D. 62 



Z All together, 410 tickets to the talent show 
were sold. 

How much money was made from ticket sales? 

A. $205 

B. $360 

C. $460 

D. $820 



8. Art Hawk sold 12 tickets for the talent show 
for $^ each. 



4. Ana was in a singing group with 5 other people. 
The group sang 3 songs in the show. They 
practiced the songs 12 hours a week for 

4 weeks. 

How many hours did Ana's group practice 
their songs for the show? 

A. 24 . 

B. 36 

C. 48 

D. 240 

5. Greg needed 1.4 meters of blue material and 
1.75 meters of white material to make his 
costume for the show. 

To find out how many meters of material Greg 
needed all together, you should 

A. divide 

B. multiply 

C. subtract 

D. add 

6. Ramon bought 12 rolls of crepe paper to 
decorate the gym for the show. The price of the 
crepe paper was 3 rolls for $.70. 

How much did Ramon pay for the crepe paper? 

A. $2.10 

B. $2£0 

C. $6.30 

D. $8.40 

7. Each of the 12 rolls of crepe paper that Ramon 
bought contained 10.5 meters of crepe paper. 

To find out how many meters of crepe paper 
there were all together, you should 

A. add 12 and 10.5 

B. divide 12 by 10.5 

C. multiply 10.5 by 12 

D. divide 10.5 by 12 

8. There were 20 different acts in the talent show. 
Each act lasted about 6 minutes. 



The best estimate of the length of time the 
20 acts lasted all together is 

A. 1 hour 

B. 2 hours 

C. 3 hours 

D. 3| hours 



How much money did Art collect? 

A. $6.00 

B. $7.00 

C. $11.50 
a $12.50 
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Nora, Odessa, and David planned a surprise party 
for Phil on his birthday. Phil and eight other 
*people were expected at the party. 



9. David planned to cook 24 hamburgers, each 
weighing about .25 pound. 

To estimate the number of pounds of 
h»mbuiger meat he needed, you should find 
the answer to 

A. 24 + .25 

B. .25 + 24 

C. 24 + .25 

D. 24 X.25. 



10 Nora, Odessa, and David went shopping. They 
needed 24 hamburger buns. Hamburger buns 
came 10 in a package. 
How many packages did they need to buy? 

A. 14 

B. 4 

C. 3 

D. 2 



11 Nora planned to make 9 liters of fruit punch 
for the 12 people coming to the lunch. One liter 
fills 4 glasses. 

How many glasses of punch did Nora plan to 
make for each person? 

A. 5I 

B. 3 

c. 2I 

D. 2 



12. Nora bought 5 cans of apple juice on sale at 3 
cans for $1.23. 

How much did Nora pay for 5 cans? 

A. $.41 

B. S.74 

C. $2.05 

D. $224 



13. Nora bought fruit juice for $4.18, 3 bottles 
of ginger ale, several packages of nuts for $1-95, 
and ice cream for $1.40. 
To find out how much money Nora spent all 
together, you need to know 

A. the price of a bottle of ginger ale 

B, how much fruit juice Nora bought 
C the price of a quart of ice cream 

D. how many packages of nuts Nora bought 

14 The fruit punch recipe Nora planned to use 
called for 50% apple juice, 25% cranberry juice, 
and 25% ginger ale. 

How much cranberry juice should Nora use 
to make 9 liters of punch? 

A. 225 liters 

B. 2.5 liters 

C. 3.6 liters 

D. 425 liters 

15. Potato chips came in different-sized bags. 
The bags looked like this. 



! 
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f 9 ouncet / \ 



POTATO 
^ CHIPS 

63«) 



1 2 Ounc« 

f 

POTATO 



16. 



Which bag cost the least per ounce? 

A. The 4-ounce bag 

B. The 5-ounce bag 

C. The 9-ounce bag 

D. The 12-ounce bag 

Nora, David, and Odessa spent a total of $12.30. 
What was the average amount spent by a 
person? 

A. $4.10 

B. $9.30 

C. $15.30 

D. $36.90 
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Tak and a group of his friends had a picnic at the 
beach. 



17* There were 18 people at the picnic, and | of 
them were girls. 

How many girls were at the picnic? 

A. 2 

B. 4 

C. 8 
a 10 



18. The 18 people had 4 jugs of lemonade. Each jug 
contained 16 cups of lemonade. 

How many cups of lemonade did they have 
all together? 

A. 72 

B. 64 

C. 54 
a 36 



19. The group brought enough fruit to the picnic for 
each of 18 people to have at least 3 pieces. 

What is the least number of pieces of fruit the 
group could have brought to the picnic? 

A. 72 

B. 63 

C. 54 

D. 21 



20. The boys and girls had to travel 20.5 kilometers 
to get to the beach. They rode a bus for 16 
kilometers and walked the rest of the way. 

How far did they walk? 

A. 25 kilometers 

B. 45 kilometers 

C. 18.9 kilometers 

D. 36.5 kilometers 



21. The cost of 18 bus fares was $1030* 

To find the cost of one bus fare, you should 

A. divide 18 by $10.80 

B. add 18 and 510.80 

Q C. multiply $10.80 by 18 

ERiC ^- ^^^^ ^® 



Last summer Ms. Foy took some girls and boys from 
Cole City to visit Oak Lane Farm for a few days. 
Estella, Charles, Vincent, Francine, and Lewis 
visited the farm. 



22. 



23. 



Oak Lane. Farm is near a village called 
Fairfield. Estelta measured the distance from 
Cole City to Fairfield on a road map. The 
distance was 14 centimeters. The scale of the 
map was 

1 centimeter = 20 kilometers 

How far is Fairfield from Cole City? 

A. 14 kilometers 

B. 28 kilometers 

C. 140 kilometers 

D. 280 kilometers 



Mr. and Mrs. Marcus own Oak Lane Farm. 
The farm is shaped like the rectangle shown in 
the figure below. 



•6 kjlom«t0rs 



2 kilomat^s 

What is the area of Oak Lane Farm? 

A. 12 square kilometers 

B. 2.4 square kilometers 

C. 4.6 square kilometers 

D. 52 square kilometers 

24. Francine and Lewis picked 2? quarts 

of blueberries, and Charles picked l| quarts 
of berries. 

To find out how many quarts of berries 
Francine, Lewis, and Charles picked all 
together, you should 

A. add 

B. subtract 

C. multiply 

D. divide 



OO ON TO THE NfXT PMV 
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25. Estella and Giarles tossed a coin to see who 
would get the next ride on the tractor. Estella 
chose heads. 

What was the probability that the coin would 
land heads up? 
A. 1 - 



26. Mr. Marcus told the visiters that 180 acres of 
land were planted, and | of those 180 acres 
were planted with corn. 

How much land was planted with corn? 

A. 60 acres 

B. 60 acres 

C. 120 acres 

D. 270 acres 



ZI Mr. and Mrs. Marcus raise pigs for the market. 
The graph below shows how many pigs they sold 
each year from 1972 to 1977. 



Pi0sSold 



28. About how many more pigs were sold in 1975 
than in 1972? (See the graph in problem 27.) 

A. 125 

B. 150 

C. 225 

D. 250 



29 The area of the vegetable garden at the farm 
was 330 square meters. Tomato plants took up 
10% of the garden space. 
How many square meters of land were planted 
with tomato plants? 

A. .33 square meters 

B. 3.3 square meters 

C. 30 square meters 

D. 33 square meters 



30 The loft of the barn is used to store hay to feed 
the animals in winter. The floor of the loft 
is rectangular, 15 meters long and 10 meters 
wide Last autumn the loft was piled 4 meters 
high with bales of hay. The figure below shows 
the shape of the space where hay was stored. 



V 

8 

-a 

I 

z 



360 
3O0 
250 
200 
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1972 1973 1974 1975 1976 1977 



The number of pigs sold incireased most from 

A. 1972 to 1973 

B. 1973 to 1974 

C. 1975 to 1976 
a 1976 to 1977 



4 rY>et«r« 




1 5 metars 



What is the volume of the space where the hay 
was stored? 

A. 60 cubic meters 

B. 150 cubic meters 

C. 300 cubic meters 

D. 600 cubic meters 



STOP HERE. 
END OF TEST. 



317 



Appendix 11 

Measurement Instruments for Assessing Students' 
(Aptitude/Attitude Inventory) and Teachers' 
(Teaching Style Inventory) Beliefs About Mathematics 
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AHlTUOe INVENTORY 



Teiehtr's N«mt 

School'^Nm . 



Girl 



T 

T 

T 

T 
T 

T 
T 

T 

T 



F 

f 

f 

F 
F 

F 

F 



Directions: 

Read eich stateneftt and decide If you usually a^ee or disagree with 
that statement If >cu agree, circle the letter T for True next to the question. 
If you disagree, circle tne letter F for False next to the question. 

Please answer every question. Be sure you write your name, your 
sex. your leacner's n^rs, dnd yz.r sc^^-col's neme on this sheet. If you have 
e question, as* >cur teacner for help. 



1, I like to «ork my math orcbleins 
with seve-3l ether students. 

2. I always ti<e to choose wnat 
math pro&le-^s to do. 

3. 1 get into trouble in school 
about once every v%aex. 

4, I do not to work alone. 

5 I work haroer on math problems 
that I know will be checked. 



I need to learn math. 

7. I need to be rcninded often to 
get my math assignment done. 

F I. I want to get good math grades 
Just to show my friends. 

F 9. I sometimes forget to do my 
assignments. 

T F 10. Practicing new math problems. 

with my teacher is a waste oT 
time. 

T F n. X <io «ot need any practice work 
before I start work on new math 
problems. 

f f 12. Tcan always remember what I 
am told to do. 

T F 13. X usually finish the easy math 
problems but not the hard ones. 

T F 14. I like my teacher to work a few 
•xample pi^oblems before I have 
to do a new problem by myself. 



T F 15. I like to learn about math best 
by listening to my teacher. 

T F 16. I will get good math grades this 
.year. 

T F 17. I am not good at math games • 
T F 18. 



T F 19. 



I usually finish my math 
assignments. 

I am good at working math 
problems In my head. 



T F 20. I get Into trouble In school 
about once every week. 

T F 21. I like to do math problems In my 
own way. 

T F 22. Hy teacher really wants me to get 
good grades In math. 

T F 23. 1 usually do not finish my math 
assignment. 

T F 24. Getting good grades In math 1$ 
really Important to me. 

T F 25. I im good at working math problems 
In my head. 

T F 26. 1 sometimes lose my books and papers. 

T F 27. 1 like to have my parents help me 
with my math problems. 

T F 28. I like to work math problems by myself. 

T F 29. I like to learn about math best by 
reading my book. 

I F 30. I always like to choose what math 
problems to do. 



PAGE OVER 
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^- ^ ^rk Wnew math p'robleffl 

without iny teacher's help. 

32. I win need math next year. 

33 Before I start working new j 
Mth problems. I IHe to make 
sure I can do them. 

34 I like to learn about math best 
by listening to my teacher. 

35. I do not like to check my math 
problecs. 

36 I like to know if a math 
assignr.ant wUl be checked. 

37. It 15 not that Important to 

kno** rath. 
3a If I ^ave a question In my math 
class, I ask the teacher right 
away. 

39. Other subjects are more important 
than math. 

40. My math teacher last year yelled 
at me ^ lot. 



T f 

T F 

T r 

T f 

T F 



T f 

T F 
T f 
T F 



T r 42. If I find «Wt y'iVll*^' 
^ ^ M . Mth problem I usu.l y do 

not «1$s th»t kind of problem 

•tain. 

T F 43. I like to be .bU to choose wh.t 
our cl»s$ does In Mth. 

T r 44 I like to h»ve my te»cher explain 
^ ^ liow to work . new math problem. 

T F 45. I -111 9et 90od math grades this 
year. 

T F 46. I do not 11 ke to check my math 
problems. 

T F 4T. Getting good grades In math Is 
really Important to me. 

T c 4a If I know my math problems will not 
^ ^ be Checked. 1 do not work on them 

very much* 

T F 49 I like to check my math problems 
^ ^ to see which problems I mused. 



T F 50. 



, «rk harder If I know -xy -"ath 
{roblems will be checked. 



T F 51. I like to work math problems In 
my head. 



41. 
I 

z 

«• o r. 



I want to get good grades just 
for myself. 



1 

1 

t 

1 

1 
1 
1 
1 
1 
1 



2 
2 

2. 

f 

2 
2 
2 
2 
2 
2 
2 



I 

I I 



3 

3 

3 

3 

3 
3 
3 
3 
3 
3 



4 
4 
4 
4 
4 
4 
4 
4 
4 
4 



i^nswer the following questions by circling . . • 

1 If you want to answer alv^avs 

2 If J^u want to answer most^U^ 

3 If Vou want to answer soneures 

4 If you want to answer ncvcr^ 

52. Do you like to be In this class? 
53 Oo you have much fun In this class? 

54. oo most of your close friends like the teacher? 

55. Does the teacher help you enough? 
56 Oo you learn a lot In this class? 

57. OO you ever feel like staying away from this class? 

58. Are you proud to be In this class? 

59. 00 you always do your best in this class? 

60 00 ypu talk In class discussions In this class? 

61. Are «ost of the students in this class friendly to you? 
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B. Teaching Style Inventory 
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k»Mi ■ 

Hrt I ClASSHOOM rWCCOUMS . ^, . 

^„ respond .s re .ntU.p.U rour cU« .01 t. t s r..r.) 

in;;. *.ppTo. or ^.t you -ould m, to h.,e h.pp.n. TMr. .r, 00 r^^t 



1. fcownt of teitma 

I t««« • "Wt" ***'■'' ^**''*' 



I |««c • Mth t«»t ot U«»t onto t»«ry 



t. 0" *«ioy»**t 

»«r» itroo* t»pHcU ««>piui1i U P«t » .•»•»'";•„ 



Tn« i,.p.rt.ncf Pf 9€tt<n9 work f^.^J^^'^ '"^ ^ 



SUdfnU un turn «n IhtU «rl i*tn l«y m f «nH»»t<. 
TMft Iff no Strict deitfllne*. 



1 
S 



4. gnrtnliitlan of t*sks 

Ho^t Ultimo tiUi in IhU diss Mvt • Ittp- 
by-step ofOirfUillon ind sei^enct. 



Host of the UjrntftO Usks In this cUii tn •opwi- 
ended" or dticovery one«le<l. 

ruth leirn>n9 otJectWes irc the »m for Oil fto^tutt 

In the cUsi. 



' mth leiVntng objectives ire set for etch sMoot 
jepifitetv. 

I. >robleffiS ^ \^ 



I Students •re\nco«ri9ca to set • lot of trUh 

their iMlh proVler.s. ^ 



Stude-.ts sre er.co;^ft?ed tc soNt thtU aith >T«blfW 
i»U»^out • lot of teecher he*p. 

T. H»!£ 2S£l 

Ainost lU help U Inltlited by »t»»deflt» mM**! for 



AlMit 111 r^lp U InltUted by ly sttlnfl tht m4 f tf 



8»11y Icssoii pUn% iff »Ublt. flft wUrtlly »ubjtct t# 



D«ny U»»Ofl p1«n$ chinked very fr«Qu«nlly. 

Hany different •ctlvUles irt ilffoit ilwiyS Qoln^ on 
jliwIUneously during r^th €l«ss. 



AImosi 111 the tire the students ire «n engaged In 
thft Seme activity during Mth c}«$$. 



The it4nd«rds *re uied for «n itudenti. ^ 

■r ' 



Different $:««d*rd» ire used for eich IndWIdWl. 

II, Cirtlmtlon procedvres 

Iviluitlon procedures «ft the siM for «n students 

In the cUss. • 



Cv«hi«tion procedures irt different for «Kh stud«f»t. 

II* Qrol prcimnion 

On « tyflcil d*y. I ijl^t an oril presentUlon for 
Ihrte- fourths of the twth tloo. 



13* fttr htiP 

Students frequently help on« Another durlnf ■»Ui elm. 



, ^ Students seldom help one inother during Mth cUss. 

!4. Instruct Ion*! dlrgctjon 

On « typU*l day. I dirfct my •llentlon to the wth 
cUss •$ • growp lhrte«fourths of the I1«*e Or we. 



On « typlcll day. I leKh or direct py iltentlon tO 
1ndtv1du«l students (or smiU groups) Ihree-fOurths 
of the t1«e or nsore. 

1$. Approiche i to lc4JiLL"Jl 

I encouraoe stuiicnls to soUe i given wih proMC« tN 
>' way 1 hdve de{^<onstrdtfd. 



I encourige students to soUe wth problems 4ny iity 
thit they dcsire. 



U. Conce ptuilliltlon 



I elmst newer five n ore! Mth presentitlon. 



I vte concepiuil «deis, such «$ the ccwjUtWe end ^ 
miclitWc properties of •ddUlon end rultlpHcitlon 
to teech nath. 



I te«ch math frow « wre pric<.k*l» loss tMorttfcil 
point of tiew. 
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iniMctWf ^^twt jggrgis!! 



the prot>le«s (IMuclWe). ^ 
out th« y««'. 



One. . «rt.1« topic 1» c«»«r«l.mt topic h n.t 
to,«r«<l .3«1<> ««<i«#t durlfl? r»vl«-». 



and prtviously 1"rned wth IdeM. 



H4th U Uu^hi strictly •» • prKtU.l subject. 



Mth U tiu9ht -Uh on th«ofy. 



21. »r^igf bimi of jtjident gut 

ic.n usually prtdUt «here.y»t«dent» •Ul bt 

thrJwth tcjitbook in Jinuiry. 



the mitri t«4iu.k sn Jinuiry. 
22. Student C»«oke 

A* to *«hit problW^l Of 



, o«,U. .h.t proUUos th, l««<l««t. .m 40 f.f -tl. 
practice. 



23. yrt-<sses^ »g<jnt 



1 know 
before 



. good de.l .boul crsludenti' ^tb •btlUIti 
Sr shortly ifur the Kbool JUT starts. 



U usually U^*V'out 9 -^^^^^ before 1 kno. .bowt 
piy Students' wih ibllUles. 



|4. Matlvitlon 



rMr6t6 In the s*iH 'o' 



All students art 



75. Wobllttjr 

pirt of tht l-th UMD". 



Hth ptrlod. 



26* With HyMtU- 



Ifi ay Mth c1«$l I e»ph«5lit tht b«U computatlowl 



In my math cUss I enph«s1ze unders landing the concepti 
underlying m«theff«lUs. 

27. Styil£il5Si 

C«ch child works "wstly it Ms own desk during math 
lesson. 



All wth work Is divided •■ong « v«r1ely of pl«ces 
(centers) In dnd out of the clissroom, with no home 
bise** seat. 

It* tftstructlonil changes 

I seldom change ny approach throughout the semester 
(such as lecture-discussion, discovery, etc.). 



I change -y approach frequently [frm discovery to 
direct telling or from another method to something 
different) throughout the semester. 

2$. Changes 

The arrangement of furnUure and equipment has changed 
every week or so, this year. 



0 

The arrangement has changed once or not at ill. 
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30. ?uje enforcement 

I enforce the classroom rules. 

Students enforce classroom rules. 

31. Memakjn£ 

1 mie the classroom rules. 

Students make the classroom rules. 

32. Reinforcement 

I generally use concrete relnforcers luch as Itan. 

I generally use verbal praise as reinforcement. 

33. Affective objectives . 

Appreciation of math Is of high Importance. 

Appreciation of math Is not vital. 

34. Igphasis on consumer math 

Heavy emphasis is placed on consumer matli. 



Little emphasii is placed on consumer mitli. 



jji, ^iff«rewcct 



, ,rr Mr. to .t«a to th. W«on pUnn.d for tMt d., 
durin9 «Jth period. 



„„d.r,U«d.«,m -ethodolo,,.. not crUU.l. 
31. g* p1or*tton 



\ 

[t 
* 3 
4 
S 



\ 
2 
3 
4 
S 



I 
I 
,3 
^4 



H)st of the 



Is spent drUlIn^ the itudenti In mi^ 



Host of Ihe 



Is ipenl t«p1or1ft9 •4tli.rtUt«< topics . 



by specific t1«e» ^"•'In? ^* 



CKn student worts U Ms or her RK.. no 
M«ifl9 resirtctlons. 



.1 

, 3 
4 



40. _ 

4t. 
4$. 



SO. 



S.,Ktthe.PPropr1.UChoU.r.r..a.f»««»- 

A • Agree 
B « Swwhit *0''«* 
C • Undecided 

0 . Sorwhdt dts*9''« 

£ - Diswee 

t-M.-upH.oo...^-;|^- 

- thin li^l'ino Ot».'*try or 

— subjects •nd *ctivu»e> 

* do wcU - 

-.t^ tficher is to convey 

--r.;;;;5rro"tr.:ti.t,.«.--.ct — 

_Boys in ^y cl.s» h*^* ^"^'^"^ '"^^^^ ^ 

uuhout th* «sistme cf • *^J^l,l^J^UKhtr showli 

■.;';r.r/rr:rp^;.ior.%or"t^ n.u.- pr.,.,. 

^d. by th. »lowe»tpu;' -. 

» nitructlOfl l«pr.ttiC»l 

,hoW CU» instruction. 
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S2. 
SI. 



to .f todiy. I h.« »»"^»» ''"^ 

^ us. pr.Ct.C C.S.S to r.1nforc. «th ,M)1,. .PP™.*- 

Mtcly *«h*t percenl*9« 

-fltlen ^rk 10 be done cU$$ 
wrUten work 10 be done «t home 
or«t work or chiUboard work 
32 9«mes or puiiles iMt tllMSinU th€ coocept 
Othf 

1551 

JoJ do to ••prov. th. »ltuaio«. 



throuQh hoi«ew»rk «nd orob1en.$ m\f^W 7- 

» M#ck for tn iveriQe of . 

M. ThU yt*r I te*ch Mth d«y5 « ^""^ • 

* iitnutes « diy. 
„. ^ ,t.d.«ts Should th. opportunU, to s.lKt .r.^u» 

auteruU on « nonstructurfJ b«»l» *t n«i 

« I „,.,n «th work to IX don. .t ^ .bout t.ti • 

the problem.) 

tht cormt inswer.) 



«^ .ftM do yixt r..1e- -.t.rUI ilr.idy «mrtdt » 



of the tSine. 

lid in undcrilandH'S ">■>»•< "'"'•'P" 

« , «>v. th. Students ,nlo n« «.ater1.1 «h,n 1 f..l thrt .11 Nt 
of the sludt-nls re.dy. 



,7. C...n present obKU.- -^""^^t^rrfllSj.lltl-.I-TMt 

5f (nuAibcr) $ludtol$. 



6(1. 



HOW mmy ye.rs (l.cludtn, thU yeir) hm yP« Uu9»»t ««! t. 
fourth glide studtf.is? 



yeirs 



O. HO- -..n, y..r, (.nCudtn, this y..r) hm yO« t.-,l.t 1« M. .l- 
•enUry school setting? 

/eirs 

70 HOW «ny hours of college credU In «th M« co-pUM <fii- 

cM<«9 ^wth wthods courses)? 



Hours 



or B.S. d.9r..T 



hour* 



EMC 



0 A W 



^„ .„Hn«nts .re checked, ^.t percent.,e would f.ll Into 
S5"fSl5.%9 categories? 

I chtck the students' papers. 
" An a-' checks the students' papers. 

Students check their own work. 

students Check each other's work 

,ou had your c^lce What type of ability in «ath would you 

prefer to leach? (Check one.) 

mostly high ability 

B«itty average abHity 
mostly low ability 
8 mixture of abilities 



Appendix 12 

Content Analysis: A Comparison of the SRA 
Achievement Series Level F Form 1 Mathematics Test and 
Holt School Mathematics 



Dr. Jere Confrey 
October, 1980 
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The following strategy was used in analyzing the test and text: First, 
I classified the test along two dimensions. One dimension was already 
specified in the test as: concepts, computations and problem, and I accepted 
their classification at face value. The other dimension was a conventional 
breakdown of the content into the categories of number sets (whole, fractions, 
decimals, and ratio and proportion) and other commonly taught topics like 
geometry and measurement, etc. These categories are roughly ordered from 
easy to complex. 

If a test item involves two content dimensions, I classified it in the 
high level. Alfo, unl^er the dimension of concepts, whole numbers could have 
Included place value, estimating patterns and factoring; however, conceptual 
understanding of whole numbers could have also included basic representations 
of whol.e numbers, number line locations or the meaning of operations on whole 

gories. 

From the categorization, I draw certain conclusions about the fit betweea 
the test and the text in terms of relative emphasis. This is done based on 
the ratio of items devoted to different topics and by comparing this to the 
order of presentation in the book. The assumption is clear: I am assuming 
that a teacher will rely on the text, proceeding in order from front to hcick 
and is less likely to complete the last sections. 

Next, 1 took the problems in the cells of the taxonomy in order from the 
upper left corner over and down and checked to see if they are taught in the 
ti^xt, sperifyinf^ the page. Wlien the text varies from the tost, a note is 
written to describe this misfit. 

Finally, I comment on some other factors about the text generally which 
mdke it distinct ivr- or which one might want to conm'der before selecting and 
ivAiVA it. 
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Test 



3! 



9/ 
O 



o 



C9 



C9 



4- 



C5 't^ 



4?^ 



A* A* 



Concepts 



Computatiou 



1. 3 
14. 15 



Problem Solving 



1. 2, 3 
A. 5, 6 
7, 8, 9 
10, 11, 
12, 13 



1, 4, 8 
10, 18. 
19 



2, 4 



7. 8. 
9 



10,1., 



28. ;9. 
30, :i 

32, :3 
34.: 5 
36.:? 
38.2 9 
40 



13.16 
17.18 



14.15, 
16,17, 
18,19. 
20,21, 
22,23, 
24,25, 
26 



20 



11.17 2,3,5.14.29 

24.26 '6.7,9. 

t 

jl3,16. 
'20.21 



27 



19 125, 26 
27 



22 



P8.29. 
30 



23.30.25,27, 
I 28 

9 



24 



21 



5.22, 
23 



O o X ' 
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Notes on Taxonomy : Rolatt ve Kmphasls 

The tesit is fairly typical in its emphasis: it testii primarily the 
topics of wliole numbers, fractions and decimals. The other topics of 
ratio and proportion, measurement and the beginnings of algebra are given 
cursory attention. This is not the case in the book. Holt School Matihcmat i^ 
begins with whole nun^bers and then emphasizes decimals, but then spends 
chapters on geometry, integers and equations, giving, in essence, an intro- 
duction to more advanced mathematics courses. It then returns to fractions 
(rational numbers), percent and real numbers. Finally, the metric system, 
coordinate geometry and probability and statistics are presented. This 
focus on preparation for algebra and geometry which is in the text is not 
reflected on the test which has 5 problems in pre-algebra and 3 on geometry. 
The book devotes 3 chapters to geometry. 

the text makes decimals be the basic number concept. It emphasizes place 
value in whole numbers and extends this to introduce decimals. Place value 
for decimals are done through powers of ten. In contrast, the test relies 
on defining decimals through fractions and tests the conceptual under- 
standing of fractions prior to that of decimals. This difference between 
test and text is serious in its implications: items^g^the test which soen> 
obvious if one learns whole numbers, fractions, decimals become far less 
obvious when fractions are taught in Chapter 9 (p. 212) and decimals in 
Chapters 2 and 3 (p. 30, 52). 
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Analysis of Individual Items 
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Classification Problem Pages 
in Taxonomy Number in 

Test Book 



Concepts 

Notes on fit between test item and book instruction 



Place 
Value 



1 1 

3 1 • 

14 37-39 

15 37-39 



On all these items there is a discrepancy between 
book and the test* The book never specifically 
provides exercises on place value, but uses the 
value of the digit (i.e., 7413: The value of the 
digit is 400) and writes it in numcrals.^^A chart 
has it written on it, but it is not used in - 
problems. Even more fundamentally, the book relies 
heavily on exponents (powers of 10), both positive 
for whole numbers and negative for decimals. 
Because of this, for items 1, 14, 15, the student 
wiil be required to make an extra step interpreting 
what 10"^ and lO"^ mean in words. Students often 
have difficulty with exponents in algebra (2 =6 is 
comm6n) and confuse negative numbers and negative 
exponents, so the choice to go this route in Holt 
is questionable • The advantage is in changing, 
bases, students^are more likely to suggest .13 
(base 

a3(base 3) = 1/3 + 3/30, 



3 - 1 X 3*""^ + 3 X 3~^' rither than the error 



Estimating 
and 

'hounding 



2 9-10 



4 2-'3 



Patterns 



6 not in 
book 



Faclorin^ 
LCM, GCF 



7 §^06-207 

8 204-205 

9 201-203 



The only comment J have on this is not any dis- 
crepancy in method, but only location in the book. 
These topics and the following ones on fractions 
(rational numbers) are placed in Chapt. 9, after 
Integers, and \vrell after decimals.' This may 
reflect an emphasis on decimals, dccmph asizing 
fractions. The test does not reflect this change. 
Furthermore, the isolation of decimals and f|acrlons 
leads to an interesting set of questions about 
the students' understanding of decimals. 
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Classification Problem Pages 
in Taxonomy Number In 

Test Book 
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on fit between test Item and book instruction 



Fractions 10 212-3 



^ ^^^^ stresses equivalence here or putting 

216-7 "m simplest terms" 

11 214-215 On comparisons, the book first advises the student 

to find common denominators and this method will 
suffice to solve this problem. In addition, the 
book (top p. 215) shows alternatively a '^cross 
multiplication" method. These methods are not 
compared and not obviously related to a student. 
Cross multiplying can be easily confused in trying 
to decide whether to put number, x der ^ first, or 
visa versa, 2 

We a" finding, in General Math study, that students 
memorize the algorithm or "shorf way" without 
understanding why it works. Again, the abbreviated 
neatness of the text obscures the fact that this 
is not 2 independent methods, but a curtailment of 
a longer method into a shorter one. 



values attached (as in money) or off a number 
line. No representation by a 10x10 "flat" is used) 

16-17 p. 236 As noted under place value, fractions are not 

stressed as directly connected to decimals. 
ScientlTic notation is the dominant mode for 
expressing decimals in this text. This is a misfit 
of test to text; how significant it is to students 
probably depends on whether their previous teaching 
reinforced this emphasis on metric as independent 
^ of fractions. 

18 p, 40-41 Again, avoiding fractions, these students would 

change ,02 to ,020 and hence say ,0I9<.020, rather 
saying either 19/100<20/100 or I9/I00< 2/10* In 
this case, staying totally within the system of 
decimals, this is relatively straight-forward. 



per cent 20 250-251 This comment is on the test. In my experience, 

students remember to move the decimal pt . two 
places, but fall to remember whether to go left or 
right so perhaps 8500 ought to be a foil. (It's 
even more dramatic when you give them a single 
digit percent.) 



/ 
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Classification Problem Pages 
ill Taxonomy Number in 

Test Book 



Ratio and 
Proportion 



Measurement 



19 p. 232- 
233 



Geomatry ani 
Coordinates 



25 



26 



p. 344-5 



not m 
text 



103 



28 p. 322 



Notes on fit between test item and book instruct ton 



Although Lhc form a/b-c/x is taught in various 
places (equivalent fractions is one which uses it), 
it is ratio and proportion where the x is not the 
product of a s;imple 'reduction' or 'inflation' of 
the left side. (However, if one simplifies 9/12 to 
3/4, then the problem becomes one like that.) Tn 
the book, the term "cross-multiplication" is not 
used, and means-extremes replaces it. There is no 
explanation that of the connection of this to 
cross multiplication used on p. 215 to compaie 
fraction or common denominators. 



This is very late in the text; it is after 
rational and real numbers, and after geometry. 
Negative i>umbcrs arc taught in one dimension, 

The stude^cs are taught congruent line segments 
(p. 82-83^ and congruent triangles (296-299). But, 
no other jcongruent figures are ia the text. 

xui£> ftiLLkou j.nLiuuuL.et> me meai|iUg oi perpenaicuiar 
and parallel as labels and show how to construct 
them. However, there are no logical exercises in 
geometry similar to that demanded by the test. 



There are nV> problems of this exact form in the 
metric section or in measurement (p. 64-73). 
However, I think to do the section on measurement 
(precision, Accuracy and errot) successful com- 
pletion of su\:h a problem would be a prerequisite, 



Exponents 



29 86-88 



30 



p. 314 



24 p. 274 



\ 



Negative & 

Positive numbers 21 



p. lio- 
ns 
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Classification 
in Taxonomy 



Problem 

Nur.bor 

Test 



in 

Book 



Equations 



22 



p.134- 
148 



134- 
148 



23 



p. 145 



Notes on fit between test item and book instruction 



This book never uses boxes, but introduces the 
'variable' and writes of solutions, roots and 
'replacements ' , 

No questions are asked in the identical form; 
however, a set of possible 'replacements' is given 
and student must try each. If students were only 
asked to solve equations, then this lack of con- 
gruence would be a case of reversing. As it is, 
this would probably cause the student little 
difficulty. 

This is taught identically 



Whole Numbers 



1-3 
4-13 



Fractions 



Decimals 



14-17 



18-26 



COMPUTATIO NS 

p. 6-8 

p. 12-14 They never do multiple digit x single digit in the 

although for estimation, horizontal displays are 
used. 



28- 


-29 


P 


.220- 


-1 


30- 


■31 


P 


222- 


-3 


32- 


■35 


P- 


224- 


-5 


36- 


38 


P- 


226- 


-7 


39- 


40 


P- 


228- 


■9 



The use of money under computation in the t?.xt is 
somewhat surprising since it breaks the trend of 
computation focusing on number solely and not 
everyday uses of the numbers. I'd like to know if 
many students get 14-17 but fail to get equivalent 
problems in 18-26. Since the book focuses on 
decimals fundamentally, the ' cuslii on! ng ' through 
money seems unnecessary and out-of-place. 



FRir 
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Classification Problem Pa[>,es , , , . ^4.^ 

in Taxonomy Number in Notes on fit between test item and book instruction 

Test Book 



Percent 27 p. 258-9 Again, the use of the box is not in tho text. 

Also, these problems arc not written as equations, 
but are written out. 

Ex: "8 is what percent of 12?" (p. 259) 



PROBLEM SOLVING 

Since problem solving involves 1) the type of numbers, 2) the form of 
context and 3) the strategies on each test problem, although they are grouped 
by number type, I will identify the other two dimensions and specify if they are 
addressed in the text. On the test, the implicit definition of problem solving 
seems to span three dimensions. Firs't, the context must be one which is 
familiar to students: school plays, picnics, talent shows, etc. arc used. 

questions are asked about that context. Finally, the problems really resemble 
traditional "word problems" or "verbal problems" in the required strategies. 
Students are usually expected to select the numbers needed, choose an operation 
and complete it. 

On occasion, they are asked to estimate which always gives exact answers) 
simply identify the operation and rend graphs. Only one time are they asked to 
identify missing information. Two problems seem to me to bo misclassif ied since 
they rely on conceptual knowledge of what an average and what odds are. 

In the text, the implicit problem solving definition varies. Throughout 
the text are sections called problem solving, which are either 1) built around 
themes which is akin to the grouping on the test or 2) applications of a parti- 
cular skill just taught (also like the text) or 3) career-oriented. However, 
the text also includes a chapter on problem solving whirli has exercises on trans* 
lating between verbal expressions and symbols, writing equations from verbal 
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Statement, writing "mini -prob] ems" making up problems from equations, drawing 
diagrams, reasoning, flow charts, specifying missing Information and estimating 
answers. Only the last two are tested on the SRA series and they each have one 
problem each. 

Two conclusions can be drawn: 

1. The test has within it a narrower definition of problem solving 

than the text, and hence fails to test much of the book's definition of problem 
solving in chapter seven. 

2. However, the book restricts this use of problem solving substantially 
to one chapter, and for the rest of the book there is a reasonable congruence 
between text and test. Why the book's authors chose to use such a restrictive 
definition throughout the rest of the text is a question which needs to be 
explored. 



Test Problem Page // in 

Number Text Context/Strategy 



Whole Numbers 1 xhe whole 



Context: School Play 
number problems Strategy: select appropriate 

are spread numbers and operations 

throughout the and complete 

text. Ex. Sec 
Pgsi/Q, 17, 27, 
48. \ 

Context: songs 
Strategy: select appropriate 

numbers and operations 
and complete 

Context: Talent show 
Strategy: estimate and select 

operation and complete 

Context: Picnic 
Strategy: Select appropriate 

operation and complete 

Context: picnic 

Strategy: Select appropriate 

numbers and operations 
T-rJ^r>' and complete 



10 



Topic 



Fractions 



Te«t 'Problem Page // in 
Number Text 



11 



Examples: 
P- 223, 
225, 227 
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Context/Strategy 



Context: Picnic 

Strategy: Select Appropriate 

operations and order 

complete 



Decimals 



17 



24 



2-3 



13 



Examples : 
p. 55, 57 
59,61,208 



Context : Picnic 
Strategy: Select appropriate 
operation - complete 

Context: berry picking 
Strategy: identify operation 



Context: School play 
Strategy: Select numbers, 

operations and complete 

Context: School play 
Strategy: Identify operntion 

Context: School dance 
Strategy: Select appropriate 

numbers and operations 

ano complete 

Context: School dance 
Strategy: Identify Operation 

Context: Picnic 

Strategy: Identify Operation 

Context: Picnic 
Strategy: Identify necessary 
inf ormati on 



16 
20 

21 



Context: Money 

Strategy: Knowing wiiat an averaj;t' 
is. 

Context : Beach 

Strategy: f>elect opiTalion and 
complete 

Context: Beach 

Strategy: Identify operation 



Per cent 14 Chapter 10 • Context: Picnic 

Examples: p. 253 Strategy: Select numbers 

257, 263, 267 operations and complete 
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Test Problem page // in 
'^^pi^ Number Text 


341 

Contcxt/S t rategy 


Percent contd. 21 






Context: Garden 
Strategy: Select numbers 

operations and complete 


Ratio and 12 
Proportion 




p. 234 


Context: Picnic 

Strategy: Select operations 

and order and complete 


15 






Context: Picnic 

Strategy: Select appropriate 

numbers off a diagram, 
operations and complete 


22 






Context: Maps 

Strategy: Select appropriate ^ 
numbers , operations 
and complete 


Measurement 23 




p. 74 


Context: Farm 

Strategy: Select appropriate 

numbers off a diagram, 


30 




p. 315 


Context: Farm 

Strategy: Select appropriate 

numbers with a diagram, 
operations and complete 


Probability & 25 
St/iristics 




368-70 


Context: Coin tossing 
Strater.y: Know probability 

concept of coins 50/50 


27 




p. 380 


Context : Fann 

Strategy: Read information off 
a graph and interpret 


28 




p. 380 


Context : Farm 

Strategy: Reading information 
off a graph 


*M'lu-ne circ all tatigtit at 
rcich this point durin[^ 


the 
the 


very end 6f the 
year. 


text. Often classes will never 
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These final comments arc about the text only. Cerlaln strengths and weaknesses 

of it merit discussion. 

1. In the text, the reading level is kept down by minimizing the verbal 
instructions. By doing so, the authors have left certain connections 
between 'short' and 'long' methods implicit so that students may 
well see them as disjoint. This is repeatedly the case in the 
displays of instruction. 

2. The development sections are a good idea to build up the concepts, 
step by step. In a sense, they reveal by contrast how complicated 
the displays really are, although they are designed as appearing 
straightforward. 

3. The text sequencing needs consideration. Area is taught algorithmlcally 
in Chapter 3, and geometrically with volume and surface area in 
MidHtcr 1^. oy eallHiat,±^J-Hg uec^maxt., iiacnuiii, die ±eiL u.iuj.± i^iiaptei 
Nine. The metric system, which I supposed motivated the emphasis on 
decimals is way back in Chapter 13, graphs are left til Chapter 15, 

and made secondary to preempting certain topics from prealgebr^ and 
geojfnetry, although graphs are likely never to be taught again. 

4. Tlif book obviously attempts to omit sex and racial stereotyping. 

In the career sections, men and women are shown at many careers, and 
the traditional roles are reversed (i.e., women plumbers, male 

.1 

food processors). In the selection of careers, there is some 
profossU.nal bias-one each of plumljing, exterminators and mechanics, 
and the rest are programmers, engineers, lawyers, wholesale buyer, 
economi'U, food processing technicians. Below, you can see that 
sexism is controlled reasonably well, but racism still exists. In 
the pn.blomq, names are selected well, and obvious attempts have been 
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made to alternate sexes in the activities. Page 172 shows two 
contexts for the equation x + 36 = 100. In one, the girl plays 
golf, the boy basketball. Both do sports which is an improvement, 
but in the girl's sport, a skirt is worn and it is fairly passive in 
contrast to basketball. In my opinion, this is still subtle sex- 
stereotyping. 



Career 



Race/Sex of Picture 



Employment Counselor 

Plumber 

Mechanic 

Biomedical Engineer 
Exterminator 



Stationary Engineer 

Food Processing Technician 

Lawyer 

Architects 

Hospital Administrator 

Teletypist 

Economists 

Wholesales 

Astronomer 



Black female 
Two white females 
White male 
White male 
White male 

White female 
Two white males 
Wliite male and female 

Oriental male, white male, 2 white females 

White female (in nurse's dress) 

American Indian (female) 

Group - mixed sex and race 

While male and female 

White male 



'to 



Appendix 13 * 

Effects of Program and Student Type on Student 
Time-On-Task Behavior in Eight-Grade Mathematics Classes 



* For more details, the reader can consult Harre (1980) 
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Dr. Ruthanne Harre. an observer in our junior high study, completed her dis- 
sertation (with some small financial assistance from the project) examining the nme- 
on-task behavior of high-, middle-, and low-achieving students in eighth-grade mathe- 
matics treatment and control classrooms. She conducted her study using a subset of 
classrooms that were participating in the general eighth-grade mathematics study. 
Her data suggest that the involvement rates of students in treatment classrooms were 
higher than those in control classrooms and thus suggests that one reason why the 
Missouri Mathematics Program may work is through increased student attention. The 
following account taken from the abstract of Dr. Harre's dissertation and three 
tables are -also presented from her dissertation. 
Purpose 

The purpose of th.s study was to investigate how different types of students 
vary in their on-task behavior patterns. Infomation was also sought which dealt 
with the interactions among student types and instructional programs, and also with 
the interactions among student types and phases of the lesson. The correlation 
between the on-task behavior of six students and that of the whole class was also 
investigated. 

Procedur e 

The study was conducted during the fall semester of the 1979-80 school year. 
Twelveeighth grade mathematics teachers from a large mid-western school system volun- 
teered to take part in the study. Of the eight schools represented by these teachers, 
four were assigned to the treatment conditions and four to the control. 

Each cla'ssroom was observed on 4 to 7 occasions, during which time data was 
recorded on how well the treatment was being implemented by the teacher as well as 
individual student on-task behavior. 
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Cluster analysis was applied to data obtained from an attitude instrument, 
as well as sex and achievement data. Four clusters (developed typologies) were 
obtained: (a) low achievers, (b) high achievers, (c) independent/motivated stu- 
dents, and (d) dependent/unmotivated students, which were employed in the student- 
treatment analyses. 

Each teacher was asked to divide each of her classes approximately into 
thirds based on achievement. The top third were labeled high achievers, the mid- 
dle third average achievers, and the remaining third as low achievers. These typo- 
logies were used in the student-treatment analyses and also in the student-lesson 
phase analyses. 

For the analyses comparing the on-task behavior of six students with that 
of the whole class, the three achievement-based typologies were again used. Six 
students (2 high achievers, 2 average, and 2 low achievers) were randomly selected 

from within each Glass. 

The treatmeisit teachers were asked to follow the guidelines set forth by 
the Missouri Mathematics Effective Project (MMEP). This basically involved asking 
the teachers to pursue a direct instructional model involving active teaching. 
The class period as detailed by the MMEP breaks down neatly into six lesson phas- 
es: (a) mental computation, (b) review, (c) dealing with homework, (d) verbal 
problem solving, (e) development, and (f) practice seatwork. 

Findings ■ * 

The two-way analysis of variance us^d to investigate the student type- 
tre-atment type interactions found significant main effects on student type (p = 
.0007) and on treatment' type (p - .0001) when the developed typologies served as 
the student types. However, the interactive effects were not signficant. Stu- 
dents displayed a significantly higher percentage of on-tastc behavior during the 
MMEP treatment conditions than during the control conditions. Dependent students 
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showed a significantly higher rate of on-task behavior than low achievers. 

When the achievement-based typologies were used significant main effects 
were again found for student type (p = .003) and for treatment type (p = .0001). 
The Interactive effect was significant at the p = .05 level. Average achievers 
displayed a significantly higher rate of on-task behavior than low achievers. 

A two-way analysis of variance, with repeated measures, was employed in 
the student-lesson phase analyses. Here again significant main effects were 
found on student type (p = .05) and on phase (p = .01), with the -interactive ef- 
fects not being significant. The phases of the lesson which pertained to mental 
computation and dealing with homework resulted in higher rates of on-task behav- 
ior than did the other four phases. 

A high positive correlation (r = .86) was found between the on-task behav- 
ior of six students and that of the whole class. 

Conclusions 

The on-task behavior of different types of students was found to vary 
across treatment instructional programs and also acrobo phases of the lesson. 

The study supported the results of two previous studies, which had shown 
that the MMEP enhanced student achievement, by showi.ig that students were also 
on-task more during the MMEP treatment as compared to the control conditions. 

The findings of this study imply that there is a strong correlation be- 
tween the on-task behavior of six students and that of the whole class. 



Table 1 
Analysis of Variance 
for Student-Treatment Analyses (Developed Typologies) 



Source 




{ MS 




F 




£ 


Treatment 


1 


3773. 


78 


33.74 


0. 


0001 


Student 


3 


660. 


67 


5.91 


0 


,0007 • 


Treatment x 
Student 


3 


197. 


16 


1.76 


0 


.1513 


Error 


608 


111. 


86 
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Table 2 
Analysis of Variance 
for Student-Treatment Analyses 
(Achievement-Based Typologies) 



Source 



df 



MS 



Ti^eatment 


1 


3259.57 


30.37 


0.0001 


Student 


2 


634.80 


5.91 


0.0029 


Treatment x 










Student 


2 


331.44 


3.09 


0.0463 


Error 


602 


107.33 
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Table 3 

Student-Treatment Interaction 



Treatment 
Condition 

Control 
Condition 



/A. 



V 

\ 



\ 



High 
Ach. 



Average 
Ach. 



Low 
Ach, 



ACHIEVEMENT-BASED STUDENT TYPOLOGIES 



Appendix 14 * 

Verbal Problem Solving Treatment Without the Structure 
of the Missouri Mathematics Effectiveness Project 



* For more details, the reader can consult Enqelhardt (1980) 
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Dr. John Engelhardt, an observer ' ur junior high study, completed his 
dissertation research (with some nancial assistance from the project) 

examining the impact of the verbal problem-solving treatment upon students 
performance in sixth-grade classrooms. Earlier (in our Field Experiment II) 
it had been shown that sixth-grade students' verbal problem-solving abilities 
were enhanced by exposing their teachers to the general Missouri Mathematics 
Program and to the verbal problem-solving treatment. The present study 
tested the verbal problem-solving treatment without the presence of the 
general treatment program. Dr. Engelhardfs data question the value of the 
verbal problem treatment in the absence of the more general program. His 
"feedback" letter to project participants follows and the interested reader 
can obtain detailed results elsewhere (Engelhardt, 1980). 

The following is a summary of the verbal problem-solving research conducted 
in the public schools from October 23, 1979 through February 6, 1980. 

The study was undertaken to experimentally test the effectiveness of a pro- 
gram of systematic instruction in verbal problem solving on the achievement 
sixth-grade students. The systematic instruction encompassed a daily time compon- 
ent of 10 minutes (except on days when verbal problem solving was the main focus 
of the lesson) and five instructional strategies to be used in teaching problem 
solvinq--using problems without numbers, writing verbal problems, estimating 
answers, reading verbal problems, and writing open sentences. 

The investigation was designed to answer the following questions: Would 
the treatment increase problem-solving achievement?. Would the observation influ- 
ence problem-achievement?. Would the treatment differentially affect the 
achievement of various groups within the class?, Would the degree of treatment 
inplementation correlate well with residual achievement scores?, and Would student 
attitude be affected? 



Half of the teachers^ were observed in order to see how well treatment 
teachers implemented the teaching requests and to measure the extent to which 
control teachers dealt with problem solving. 

After initial instruction during an orientation workshop, the teachers in 
the treatment group were responsible for maintaining the problem-solving program 
in their classrooms. The teachers' main references were the Verbal Problem Solv- 
ing Manual and a Procedure Summary. Beyond these, teachers were to generate the 
resources necessary for the instructional program. At the conclusion of the ex- 
periment all teachers administered a problem-solving test and an attitude scale. 

Since no pretests were administered, district data on file from Spring, 
1979, testinq were used as covariates in the analyses. Those students for whom 
complete data were on file were considered in the statistical analyses. 

Results and Conclusions 

With respect to the questions under investigation the following results 
were noted: 

1. The treatment did not make a difference in problem-solving performance 
either on routine or nonroutine problems. The adjusted mean for the control group 
was higher than that of the treatment group for routine problems, and the reverse 
was true for nonroutine problems. Neither difference was significant statistically. 

2. Observation was not a factor in problem-solving achievement as the ob- 
served group did not differ appreciably from the unobserved group in achievement. 

3. The treatment did not have differential effects among high, average, or 
low groups (within classes) when prior achievement was taken into consideration. 
However, the average group scored higher than the high group after adjustment. 

4. On the attitude toward mathematics scale th^^ control group scored sig- 
nificantly higher than the treatment group, although both groups' scores exhibited 
a ^ode'^ately positive attitude toward mathematics. 
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Based on self-report information from teacher logs, the treatment teachers 
followed the teaching requests outlined for them at the orientation session prior 
to the study. The mean number of daily minutes spent on problem solving was 17 
and problem solving was covered on 73^^ of the days school was in session. The 
averaged to over 10 minutes per school day on problem solving. Treatment teachers 
reacted favorably to the project although some had reservations as to its poten- 
tial for widespread acceptance due to increased preparation time and development 
of material s. 

Discussion 

D.ie to the small sample size of 16 teachers, the results were not expected 
to reach statistical significance. However, the fact that the control group sur- 
passed the treatment group ever, after adjustment for initial differences was most 
unexpected. Several plausible considerations suggest themselvas. 

Previous research supports the use of instructional strategies as a means 
to increase problem-solving achievement. The present study was designed to make 
use of regular classroom teachers in a natural school setting, with teachers using 
available resources. Since teachers were responsible for generating their own 
resources, some additional preparation was required. For some this may have become 
a burden. It may be unreasonable to axpect teachers to carry out this type of pro- 
gram without additional feedback or material. 

Another con-^ideration which clouded interpretation of the results was that 
the trc-atnent and control groups were not identical on the pretest measures. Con- 
trol classes exceeded treatment classes by 2/3 of a standard deviation in prior 
proDi-m-solvinq achievement and by one standard deviation on knowledge of mathe- 
matics concepts. Although adjustment for this difference was made in the statis- 
tical work by using analysis of covariance, this does not imply that the groups 
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were comparable. The fact that teachers were randomly assigned to experimental 
conditions guaranteed a bias-free assign^nent, not equivalent groups. The treat- 
ment group, being lower than the control, may have had a more difficult time in- 
creasing problem-solving achievement than would a group equivalent to the control. 

A final rationale for the lack of anticipated results comes from a comment 
made by a teacher during an interview. He mentioned that he thought the program 
was beneficial but didn't think it would show up on a test due to the short length 
of the treatment. He indicated that to bring about desirable results would require, 
in his opinion, a full year of exposure to the program. 

Another surprising result was the significant difference on attitude toward 
mathematics, with the control group scoring higher than the treatment group. This 
result is based solely on posttesting as no preexperimental attitude measure was 
administered. Both groups scored between 3 and 4 on a 5-point scale indicating a 
moderately positive attitude toward mathematics. Though the difference was statis- 
tically significant, the educational significance is negligible, given that the 
arouD means differed by less than six points out of a possible 130. 

It is worth mentioning that in their interviews teachers indicated a favor- 
able reaction to the program. Some noticed changes in their students' reaction to 
word problems. Several teachers said they thought student attitude toward verbal 
Droblems improved and students were not as apprehensive about working verbal pro- 
blems as they had been. 

Imnl i cations 

Systematic instruction in verbal problem solving is not a sufficient condi- 
tion to increase problem-solving achievement in a classroom setting when regular 
teachers use normally available classroom materials. Additional training sessions 
wii^' teachers may be appropriate and observational feedback may be helpful in keep- 
ing teachers on task. A longer treatment period (a f:ll school year) would be 
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desirable. Finally, in order to carry out this type of program perhaps more mater- 
ials like problem sets should be made available, as this would ease the preparation 
burden. 
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